2023-02-11 19:03:08,336 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-11 19:03:08,382 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=167, AvailableMemoryMB=5242 2023-02-11 19:03:08,661 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46 2023-02-11 19:03:08,668 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:03:08,669 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b, deleteOnExit=true 2023-02-11 19:03:08,669 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:03:08,669 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/test.cache.data in system properties and HBase conf 2023-02-11 19:03:08,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:03:08,670 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:03:08,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:03:08,671 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:03:08,671 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:03:08,785 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 19:03:09,202 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:03:09,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:09,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:09,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:03:09,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:09,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:03:09,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:03:09,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:09,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:09,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:03:09,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:03:09,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:03:09,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:09,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:03:09,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:03:09,745 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:09,749 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:10,091 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 19:03:10,289 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-11 19:03:10,305 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:10,351 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:10,387 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/java.io.tmpdir/Jetty_localhost_46233_hdfs____.ugv4sm/webapp 2023-02-11 19:03:10,540 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46233 2023-02-11 19:03:10,554 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:10,554 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:11,116 WARN [Listener at localhost/44011] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:11,197 WARN [Listener at localhost/44011] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:11,220 WARN [Listener at localhost/44011] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:11,228 INFO [Listener at localhost/44011] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:11,242 INFO [Listener at localhost/44011] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/java.io.tmpdir/Jetty_localhost_40647_datanode____oahack/webapp 2023-02-11 19:03:11,377 INFO [Listener at localhost/44011] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40647 2023-02-11 19:03:11,850 WARN [Listener at localhost/40419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:11,911 WARN [Listener at localhost/40419] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:11,915 WARN [Listener at localhost/40419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:11,917 INFO [Listener at localhost/40419] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:11,931 INFO [Listener at localhost/40419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/java.io.tmpdir/Jetty_localhost_44333_datanode____eitinu/webapp 2023-02-11 19:03:12,043 INFO [Listener at localhost/40419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44333 2023-02-11 19:03:12,067 WARN [Listener at localhost/37527] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:12,458 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f3bc5e4cdfb7005: Processing first storage report for DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9 from datanode 58bf8f62-0565-4326-bc0e-0f0bd52ddbe6 2023-02-11 19:03:12,460 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f3bc5e4cdfb7005: from storage DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9 node DatanodeRegistration(127.0.0.1:34757, datanodeUuid=58bf8f62-0565-4326-bc0e-0f0bd52ddbe6, infoPort=39009, infoSecurePort=0, ipcPort=37527, storageInfo=lv=-57;cid=testClusterID;nsid=1038230625;c=1676142189830), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-02-11 19:03:12,461 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaa64ee92be36b74f: Processing first storage report for DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c from datanode a8269ed7-e33a-44a0-aad6-80c5155f6057 2023-02-11 19:03:12,461 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaa64ee92be36b74f: from storage DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c node DatanodeRegistration(127.0.0.1:39279, datanodeUuid=a8269ed7-e33a-44a0-aad6-80c5155f6057, infoPort=44849, infoSecurePort=0, ipcPort=40419, storageInfo=lv=-57;cid=testClusterID;nsid=1038230625;c=1676142189830), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 19:03:12,461 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaa64ee92be36b74f: Processing first storage report for DS-1d945309-5637-4f2c-ab12-c03ac1f2dd3c from datanode a8269ed7-e33a-44a0-aad6-80c5155f6057 2023-02-11 19:03:12,461 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaa64ee92be36b74f: from storage DS-1d945309-5637-4f2c-ab12-c03ac1f2dd3c node DatanodeRegistration(127.0.0.1:39279, datanodeUuid=a8269ed7-e33a-44a0-aad6-80c5155f6057, infoPort=44849, infoSecurePort=0, ipcPort=40419, storageInfo=lv=-57;cid=testClusterID;nsid=1038230625;c=1676142189830), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:12,461 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f3bc5e4cdfb7005: Processing first storage report for DS-e54a1ec2-37a6-4c39-93da-b15d2b2a0744 from datanode 58bf8f62-0565-4326-bc0e-0f0bd52ddbe6 2023-02-11 19:03:12,462 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f3bc5e4cdfb7005: from storage DS-e54a1ec2-37a6-4c39-93da-b15d2b2a0744 node DatanodeRegistration(127.0.0.1:34757, datanodeUuid=58bf8f62-0565-4326-bc0e-0f0bd52ddbe6, infoPort=39009, infoSecurePort=0, ipcPort=37527, storageInfo=lv=-57;cid=testClusterID;nsid=1038230625;c=1676142189830), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 19:03:12,606 DEBUG [Listener at localhost/37527] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46 2023-02-11 19:03:12,724 INFO [Listener at localhost/37527] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/zookeeper_0, clientPort=59241, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:03:12,742 INFO [Listener at localhost/37527] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59241 2023-02-11 19:03:12,753 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:12,756 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:13,443 INFO [Listener at localhost/37527] util.FSUtils(479): Created version file at hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e with version=8 2023-02-11 19:03:13,443 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:13,446 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:13,450 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/hbase-staging 2023-02-11 19:03:13,785 INFO [Listener at localhost/37527] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 19:03:14,251 INFO [Listener at localhost/37527] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:14,284 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,284 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,285 INFO [Listener at localhost/37527] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:14,285 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,285 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:14,430 INFO [Listener at localhost/37527] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:14,502 DEBUG [Listener at localhost/37527] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 19:03:14,593 INFO [Listener at localhost/37527] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35183 2023-02-11 19:03:14,603 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:14,605 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:14,627 INFO [Listener at localhost/37527] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35183 connecting to ZooKeeper ensemble=127.0.0.1:59241 2023-02-11 19:03:14,683 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:351830x0, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:14,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35183-0x10044c412040000 connected 2023-02-11 19:03:14,716 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:14,717 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:14,721 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:14,729 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35183 2023-02-11 19:03:14,729 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35183 2023-02-11 19:03:14,730 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35183 2023-02-11 19:03:14,730 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35183 2023-02-11 19:03:14,731 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35183 2023-02-11 19:03:14,739 INFO [Listener at localhost/37527] master.HMaster(439): hbase.rootdir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e, hbase.cluster.distributed=false 2023-02-11 19:03:14,808 INFO [Listener at localhost/37527] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:14,808 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,808 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,808 INFO [Listener at localhost/37527] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:14,808 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,808 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:14,813 INFO [Listener at localhost/37527] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:14,816 INFO [Listener at localhost/37527] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45665 2023-02-11 19:03:14,818 INFO [Listener at localhost/37527] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:14,825 DEBUG [Listener at localhost/37527] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:14,826 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:14,828 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:14,830 INFO [Listener at localhost/37527] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45665 connecting to ZooKeeper ensemble=127.0.0.1:59241 2023-02-11 19:03:14,835 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:456650x0, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:14,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45665-0x10044c412040001 connected 2023-02-11 19:03:14,837 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:14,838 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:14,839 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:14,839 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45665 2023-02-11 19:03:14,839 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45665 2023-02-11 19:03:14,844 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45665 2023-02-11 19:03:14,844 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45665 2023-02-11 19:03:14,845 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45665 2023-02-11 19:03:14,857 INFO [Listener at localhost/37527] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:14,857 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,857 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,858 INFO [Listener at localhost/37527] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:14,858 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:14,858 INFO [Listener at localhost/37527] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:14,858 INFO [Listener at localhost/37527] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:14,859 INFO [Listener at localhost/37527] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46149 2023-02-11 19:03:14,860 INFO [Listener at localhost/37527] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:14,861 DEBUG [Listener at localhost/37527] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:14,862 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:14,865 INFO [Listener at localhost/37527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:14,867 INFO [Listener at localhost/37527] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46149 connecting to ZooKeeper ensemble=127.0.0.1:59241 2023-02-11 19:03:14,871 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:461490x0, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:14,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46149-0x10044c412040002 connected 2023-02-11 19:03:14,872 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:14,873 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:14,874 DEBUG [Listener at localhost/37527] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:14,876 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46149 2023-02-11 19:03:14,876 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46149 2023-02-11 19:03:14,876 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46149 2023-02-11 19:03:14,879 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46149 2023-02-11 19:03:14,880 DEBUG [Listener at localhost/37527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46149 2023-02-11 19:03:14,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:14,893 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:14,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:14,914 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:14,915 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:14,914 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:14,915 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:14,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35183,1676142193612 from backup master directory 2023-02-11 19:03:14,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:14,922 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:14,922 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:14,923 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:14,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:14,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-11 19:03:14,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-11 19:03:15,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/hbase.id with ID: 443a2f64-2536-4812-93bb-c3933ad12f8a 2023-02-11 19:03:15,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:15,096 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:15,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x09391391 to 127.0.0.1:59241 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:15,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@611812dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:15,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:15,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:03:15,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 19:03:15,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 19:03:15,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 19:03:15,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 19:03:15,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:15,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store-tmp 2023-02-11 19:03:15,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:15,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:15,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:15,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:15,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:15,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:15,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:15,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142195309Disabling compacts and flushes for region at 1676142195309Disabling writes for close at 1676142195310 (+1 ms)Writing region close event to WAL at 1676142195310Closed at 1676142195310 2023-02-11 19:03:15,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/WALs/jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:15,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35183%2C1676142193612, suffix=, logDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/WALs/jenkins-hbase4.apache.org,35183,1676142193612, archiveDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/oldWALs, maxLogs=10 2023-02-11 19:03:15,393 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK] 2023-02-11 19:03:15,393 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK] 2023-02-11 19:03:15,402 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-11 19:03:15,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/WALs/jenkins-hbase4.apache.org,35183,1676142193612/jenkins-hbase4.apache.org%2C35183%2C1676142193612.1676142195347 2023-02-11 19:03:15,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK], DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK]] 2023-02-11 19:03:15,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:15,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:15,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:15,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:15,536 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:15,544 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:03:15,576 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:03:15,588 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:15,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:15,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:15,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:15,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:15,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65081339, jitterRate=-0.03021247684955597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:15,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142195504Initializing all the Stores at 1676142195507 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142195507Cleaning up temporary data from old regions at 1676142195602 (+95 ms)Cleaning up detritus from prior splits at 1676142195603 (+1 ms)Region opened successfully at 1676142195615 (+12 ms) 2023-02-11 19:03:15,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:03:15,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:03:15,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:03:15,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:03:15,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-11 19:03:15,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-11 19:03:15,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:03:15,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:03:15,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:03:15,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:03:15,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:03:15,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:03:15,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:03:15,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:03:15,755 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:15,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:03:15,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:03:15,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:03:15,777 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:15,777 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:15,777 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:15,777 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:15,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35183,1676142193612, sessionid=0x10044c412040000, setting cluster-up flag (Was=false) 2023-02-11 19:03:15,794 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:15,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:03:15,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:15,806 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:15,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:03:15,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:15,816 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.hbase-snapshot/.tmp 2023-02-11 19:03:15,885 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(952): ClusterId : 443a2f64-2536-4812-93bb-c3933ad12f8a 2023-02-11 19:03:15,890 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(952): ClusterId : 443a2f64-2536-4812-93bb-c3933ad12f8a 2023-02-11 19:03:15,896 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:15,896 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:15,903 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:15,903 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:15,903 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:15,903 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:15,907 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:15,909 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:15,909 DEBUG [RS:1;jenkins-hbase4:46149] zookeeper.ReadOnlyZKClient(139): Connect 0x48a6a71d to 127.0.0.1:59241 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:15,910 DEBUG [RS:0;jenkins-hbase4:45665] zookeeper.ReadOnlyZKClient(139): Connect 0x5c122370 to 127.0.0.1:59241 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:15,922 DEBUG [RS:0;jenkins-hbase4:45665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52d5c682, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:15,923 DEBUG [RS:1;jenkins-hbase4:46149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46614079, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:15,923 DEBUG [RS:1;jenkins-hbase4:46149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425ecc6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:15,923 DEBUG [RS:0;jenkins-hbase4:45665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56ea4800, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:15,953 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45665 2023-02-11 19:03:15,953 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46149 2023-02-11 19:03:15,959 INFO [RS:1;jenkins-hbase4:46149] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:15,960 INFO [RS:1;jenkins-hbase4:46149] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:15,959 INFO [RS:0;jenkins-hbase4:45665] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:15,960 INFO [RS:0;jenkins-hbase4:45665] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:15,960 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:15,960 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:15,963 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35183,1676142193612 with isa=jenkins-hbase4.apache.org/172.31.14.131:45665, startcode=1676142194807 2023-02-11 19:03:15,963 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35183,1676142193612 with isa=jenkins-hbase4.apache.org/172.31.14.131:46149, startcode=1676142194856 2023-02-11 19:03:15,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:15,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142225979 2023-02-11 19:03:15,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:03:15,983 DEBUG [RS:1;jenkins-hbase4:46149] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:15,983 DEBUG [RS:0;jenkins-hbase4:45665] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:15,984 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:15,985 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:03:15,990 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:15,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:03:16,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:03:16,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:03:16,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:03:16,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:03:16,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:03:16,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:03:16,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:03:16,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:03:16,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:03:16,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142196024,5,FailOnTimeoutGroup] 2023-02-11 19:03:16,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142196027,5,FailOnTimeoutGroup] 2023-02-11 19:03:16,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:03:16,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,049 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:16,059 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57345, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:16,064 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:16,064 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e 2023-02-11 19:03:16,059 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53547, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:16,124 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35183] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,158 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e 2023-02-11 19:03:16,158 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e 2023-02-11 19:03:16,159 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44011 2023-02-11 19:03:16,159 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44011 2023-02-11 19:03:16,159 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:16,159 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:16,173 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:16,174 DEBUG [RS:0;jenkins-hbase4:45665] zookeeper.ZKUtil(162): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,174 DEBUG [RS:1;jenkins-hbase4:46149] zookeeper.ZKUtil(162): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,174 WARN [RS:0;jenkins-hbase4:45665] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:16,175 WARN [RS:1;jenkins-hbase4:46149] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:16,175 INFO [RS:0;jenkins-hbase4:45665] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:16,175 INFO [RS:1;jenkins-hbase4:46149] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:16,176 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,176 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,177 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:16,176 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45665,1676142194807] 2023-02-11 19:03:16,180 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46149,1676142194856] 2023-02-11 19:03:16,181 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:16,186 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/info 2023-02-11 19:03:16,187 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:16,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:16,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:16,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:16,192 DEBUG [RS:0;jenkins-hbase4:45665] zookeeper.ZKUtil(162): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,193 DEBUG [RS:1;jenkins-hbase4:46149] zookeeper.ZKUtil(162): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,193 DEBUG [RS:0;jenkins-hbase4:45665] zookeeper.ZKUtil(162): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,193 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:16,194 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:16,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:16,195 DEBUG [RS:1;jenkins-hbase4:46149] zookeeper.ZKUtil(162): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,198 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/table 2023-02-11 19:03:16,198 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:16,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:16,201 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740 2023-02-11 19:03:16,202 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740 2023-02-11 19:03:16,206 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:16,206 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:16,206 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:16,209 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:16,213 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:16,214 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68703859, jitterRate=0.023767277598381042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:16,214 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142196177Initializing all the Stores at 1676142196179 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142196179Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142196181 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142196181Cleaning up temporary data from old regions at 1676142196204 (+23 ms)Cleaning up detritus from prior splits at 1676142196205 (+1 ms)Region opened successfully at 1676142196214 (+9 ms) 2023-02-11 19:03:16,214 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:16,215 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:16,215 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:16,215 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:16,215 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:16,218 INFO [RS:1;jenkins-hbase4:46149] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:16,218 INFO [RS:0;jenkins-hbase4:45665] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:16,218 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:16,218 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142196214Disabling compacts and flushes for region at 1676142196214Disabling writes for close at 1676142196215 (+1 ms)Writing region close event to WAL at 1676142196218 (+3 ms)Closed at 1676142196218 2023-02-11 19:03:16,226 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:16,226 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:03:16,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:03:16,241 INFO [RS:0;jenkins-hbase4:45665] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:16,241 INFO [RS:1;jenkins-hbase4:46149] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:16,246 INFO [RS:0;jenkins-hbase4:45665] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:16,246 INFO [RS:1;jenkins-hbase4:46149] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:16,246 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,246 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,248 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:03:16,249 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:16,249 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:16,251 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:03:16,259 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,259 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,259 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,259 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,259 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,259 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:16,260 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,260 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:16,260 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,261 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,261 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,261 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,261 DEBUG [RS:0;jenkins-hbase4:45665] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,261 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,261 DEBUG [RS:1;jenkins-hbase4:46149] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:16,264 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,264 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,264 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,267 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,267 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,267 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,285 INFO [RS:1;jenkins-hbase4:46149] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:16,285 INFO [RS:0;jenkins-hbase4:45665] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:16,290 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46149,1676142194856-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,290 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45665,1676142194807-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,318 INFO [RS:1;jenkins-hbase4:46149] regionserver.Replication(203): jenkins-hbase4.apache.org,46149,1676142194856 started 2023-02-11 19:03:16,318 INFO [RS:0;jenkins-hbase4:45665] regionserver.Replication(203): jenkins-hbase4.apache.org,45665,1676142194807 started 2023-02-11 19:03:16,318 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46149,1676142194856, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46149, sessionid=0x10044c412040002 2023-02-11 19:03:16,319 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45665,1676142194807, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45665, sessionid=0x10044c412040001 2023-02-11 19:03:16,319 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:16,319 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:16,319 DEBUG [RS:1;jenkins-hbase4:46149] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,319 DEBUG [RS:0;jenkins-hbase4:45665] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,320 DEBUG [RS:1;jenkins-hbase4:46149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46149,1676142194856' 2023-02-11 19:03:16,320 DEBUG [RS:0;jenkins-hbase4:45665] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45665,1676142194807' 2023-02-11 19:03:16,321 DEBUG [RS:0;jenkins-hbase4:45665] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:16,320 DEBUG [RS:1;jenkins-hbase4:46149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:16,321 DEBUG [RS:0;jenkins-hbase4:45665] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:16,322 DEBUG [RS:1;jenkins-hbase4:46149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:16,322 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:16,322 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:16,322 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:16,322 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:16,323 DEBUG [RS:0;jenkins-hbase4:45665] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,323 DEBUG [RS:1;jenkins-hbase4:46149] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:16,323 DEBUG [RS:0;jenkins-hbase4:45665] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45665,1676142194807' 2023-02-11 19:03:16,323 DEBUG [RS:1;jenkins-hbase4:46149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46149,1676142194856' 2023-02-11 19:03:16,323 DEBUG [RS:1;jenkins-hbase4:46149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:16,323 DEBUG [RS:0;jenkins-hbase4:45665] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:16,324 DEBUG [RS:1;jenkins-hbase4:46149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:16,324 DEBUG [RS:0;jenkins-hbase4:45665] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:16,325 DEBUG [RS:1;jenkins-hbase4:46149] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:16,325 INFO [RS:1;jenkins-hbase4:46149] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:16,325 DEBUG [RS:0;jenkins-hbase4:45665] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:16,325 INFO [RS:1;jenkins-hbase4:46149] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:16,325 INFO [RS:0;jenkins-hbase4:45665] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:16,326 INFO [RS:0;jenkins-hbase4:45665] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:16,403 DEBUG [jenkins-hbase4:35183] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:03:16,408 DEBUG [jenkins-hbase4:35183] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:16,415 DEBUG [jenkins-hbase4:35183] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:16,415 DEBUG [jenkins-hbase4:35183] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:16,415 DEBUG [jenkins-hbase4:35183] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:16,418 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45665,1676142194807, state=OPENING 2023-02-11 19:03:16,426 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:03:16,428 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:16,429 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:16,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:16,619 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:16,621 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:16,625 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39150, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:16,642 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:03:16,642 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:16,646 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45665%2C1676142194807.meta, suffix=.meta, logDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,45665,1676142194807, archiveDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/oldWALs, maxLogs=32 2023-02-11 19:03:16,671 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK] 2023-02-11 19:03:16,671 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK] 2023-02-11 19:03:16,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,45665,1676142194807/jenkins-hbase4.apache.org%2C45665%2C1676142194807.meta.1676142196650.meta 2023-02-11 19:03:16,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK], DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK]] 2023-02-11 19:03:16,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:16,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:03:16,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:03:16,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:03:16,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:03:16,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:16,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:03:16,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:03:16,712 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:16,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/info 2023-02-11 19:03:16,714 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/info 2023-02-11 19:03:16,715 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:16,716 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:16,716 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:16,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:16,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:16,718 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:16,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:16,719 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:16,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/table 2023-02-11 19:03:16,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/table 2023-02-11 19:03:16,722 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:16,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:16,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740 2023-02-11 19:03:16,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740 2023-02-11 19:03:16,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:16,737 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:16,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61540568, jitterRate=-0.08297407627105713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:16,739 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142196709Writing region info on filesystem at 1676142196710 (+1 ms)Initializing all the Stores at 1676142196711 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142196711Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142196712 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142196712Cleaning up temporary data from old regions at 1676142196731 (+19 ms)Cleaning up detritus from prior splits at 1676142196732 (+1 ms)Running coprocessor post-open hooks at 1676142196739 (+7 ms)Region opened successfully at 1676142196739 2023-02-11 19:03:16,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142196611 2023-02-11 19:03:16,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:03:16,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:03:16,774 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45665,1676142194807, state=OPEN 2023-02-11 19:03:16,778 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:03:16,778 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:16,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:03:16,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45665,1676142194807 in 346 msec 2023-02-11 19:03:16,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:03:16,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-02-11 19:03:16,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 915 msec 2023-02-11 19:03:16,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142194910, completionTime=-1 2023-02-11 19:03:16,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:03:16,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:03:16,859 DEBUG [hconnection-0x465dbe06-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:16,862 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:16,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:03:16,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142256886 2023-02-11 19:03:16,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142316886 2023-02-11 19:03:16,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 92 msec 2023-02-11 19:03:16,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35183,1676142193612-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35183,1676142193612-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35183,1676142193612-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35183, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:16,918 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:03:16,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:03:16,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:16,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:03:16,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:16,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:16,964 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:16,967 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2 empty. 2023-02-11 19:03:16,968 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:16,968 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:03:16,996 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:16,998 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3bb74a868c81396c725be5a0e27255b2, NAME => 'hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:17,016 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:17,016 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3bb74a868c81396c725be5a0e27255b2, disabling compactions & flushes 2023-02-11 19:03:17,016 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. after waiting 0 ms 2023-02-11 19:03:17,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,017 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3bb74a868c81396c725be5a0e27255b2: Waiting for close lock at 1676142197016Disabling compacts and flushes for region at 1676142197016Disabling writes for close at 1676142197017 (+1 ms)Writing region close event to WAL at 1676142197017Closed at 1676142197017 2023-02-11 19:03:17,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:17,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142197025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142197025"}]},"ts":"1676142197025"} 2023-02-11 19:03:17,064 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:17,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:17,072 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142197067"}]},"ts":"1676142197067"} 2023-02-11 19:03:17,077 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:03:17,081 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:17,084 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:17,084 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:17,084 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:17,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3bb74a868c81396c725be5a0e27255b2, ASSIGN}] 2023-02-11 19:03:17,090 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3bb74a868c81396c725be5a0e27255b2, ASSIGN 2023-02-11 19:03:17,091 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3bb74a868c81396c725be5a0e27255b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46149,1676142194856; forceNewPlan=false, retain=false 2023-02-11 19:03:17,245 INFO [jenkins-hbase4:35183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:17,246 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3bb74a868c81396c725be5a0e27255b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:17,246 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142197245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142197245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142197245"}]},"ts":"1676142197245"} 2023-02-11 19:03:17,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3bb74a868c81396c725be5a0e27255b2, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:17,337 INFO [RS:1;jenkins-hbase4:46149] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46149%2C1676142194856, suffix=, logDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,46149,1676142194856, archiveDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/oldWALs, maxLogs=32 2023-02-11 19:03:17,337 INFO [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45665%2C1676142194807, suffix=, logDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,45665,1676142194807, archiveDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/oldWALs, maxLogs=32 2023-02-11 19:03:17,356 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK] 2023-02-11 19:03:17,357 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK] 2023-02-11 19:03:17,360 INFO [RS:1;jenkins-hbase4:46149] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,46149,1676142194856/jenkins-hbase4.apache.org%2C46149%2C1676142194856.1676142197338 2023-02-11 19:03:17,361 DEBUG [RS:1;jenkins-hbase4:46149] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK], DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK]] 2023-02-11 19:03:17,363 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK] 2023-02-11 19:03:17,364 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK] 2023-02-11 19:03:17,372 INFO [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/WALs/jenkins-hbase4.apache.org,45665,1676142194807/jenkins-hbase4.apache.org%2C45665%2C1676142194807.1676142197339 2023-02-11 19:03:17,374 DEBUG [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34757,DS-afebe669-2ba2-4551-ad22-2dac0aa50ce9,DISK], DatanodeInfoWithStorage[127.0.0.1:39279,DS-cdc5d5a2-b5c6-40d5-adde-840f97a3b96c,DISK]] 2023-02-11 19:03:17,405 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:17,405 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:17,408 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:17,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3bb74a868c81396c725be5a0e27255b2, NAME => 'hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:17,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:17,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,418 INFO [StoreOpener-3bb74a868c81396c725be5a0e27255b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,420 DEBUG [StoreOpener-3bb74a868c81396c725be5a0e27255b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/info 2023-02-11 19:03:17,421 DEBUG [StoreOpener-3bb74a868c81396c725be5a0e27255b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/info 2023-02-11 19:03:17,421 INFO [StoreOpener-3bb74a868c81396c725be5a0e27255b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bb74a868c81396c725be5a0e27255b2 columnFamilyName info 2023-02-11 19:03:17,422 INFO [StoreOpener-3bb74a868c81396c725be5a0e27255b2-1] regionserver.HStore(310): Store=3bb74a868c81396c725be5a0e27255b2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:17,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:17,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:17,435 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3bb74a868c81396c725be5a0e27255b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66113451, jitterRate=-0.014832809567451477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:17,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3bb74a868c81396c725be5a0e27255b2: Running coprocessor pre-open hook at 1676142197416Writing region info on filesystem at 1676142197416Initializing all the Stores at 1676142197417 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142197417Cleaning up temporary data from old regions at 1676142197426 (+9 ms)Cleaning up detritus from prior splits at 1676142197427 (+1 ms)Running coprocessor post-open hooks at 1676142197435 (+8 ms)Region opened successfully at 1676142197435 2023-02-11 19:03:17,438 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2., pid=6, masterSystemTime=1676142197405 2023-02-11 19:03:17,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,444 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:17,446 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3bb74a868c81396c725be5a0e27255b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:17,446 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142197445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142197445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142197445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142197445"}]},"ts":"1676142197445"} 2023-02-11 19:03:17,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:03:17,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3bb74a868c81396c725be5a0e27255b2, server=jenkins-hbase4.apache.org,46149,1676142194856 in 200 msec 2023-02-11 19:03:17,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:03:17,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3bb74a868c81396c725be5a0e27255b2, ASSIGN in 370 msec 2023-02-11 19:03:17,461 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:17,462 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142197461"}]},"ts":"1676142197461"} 2023-02-11 19:03:17,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:03:17,471 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:17,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 542 msec 2023-02-11 19:03:17,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:03:17,543 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:17,543 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:17,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:17,569 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49244, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:17,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:03:17,610 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:17,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-02-11 19:03:17,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:03:17,633 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:17,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-11 19:03:17,648 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:03:17,650 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:03:17,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.728sec 2023-02-11 19:03:17,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:03:17,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:03:17,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:03:17,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35183,1676142193612-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:03:17,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35183,1676142193612-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:03:17,692 DEBUG [Listener at localhost/37527] zookeeper.ReadOnlyZKClient(139): Connect 0x5514a3bb to 127.0.0.1:59241 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:17,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:03:17,698 DEBUG [Listener at localhost/37527] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fd6b974, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:17,734 DEBUG [hconnection-0x28707e63-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:17,745 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:17,756 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:17,756 DEBUG [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:03:17,765 DEBUG [Listener at localhost/37527] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:03:17,768 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:03:17,772 INFO [Listener at localhost/37527] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 19:03:17,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 19:03:17,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:03:17,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:53088 deadline: 1676142257776, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 19:03:17,796 INFO [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 19:03:17,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:17,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 19:03:17,815 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:17,817 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:17,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 19:03:17,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:17,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:17,859 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b empty. 2023-02-11 19:03:17,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:17,861 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d empty. 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:17,865 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:17,866 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 empty. 2023-02-11 19:03:17,866 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc empty. 2023-02-11 19:03:17,866 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 empty. 2023-02-11 19:03:17,867 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:17,867 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:17,867 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:17,867 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:17,868 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 empty. 2023-02-11 19:03:17,868 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:17,868 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef empty. 2023-02-11 19:03:17,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f empty. 2023-02-11 19:03:17,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 empty. 2023-02-11 19:03:17,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 empty. 2023-02-11 19:03:17,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:17,870 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:17,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:17,870 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:17,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:17,870 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 19:03:17,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:18,297 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:18,299 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c126b1c0300e95aceccfe332563e63fc, NAME => 'testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,299 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1b17bd65213dcae81dbc9ac62b8fb31b, NAME => 'testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,299 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 35c49d2dfa905e03084d83b93e20035d, NAME => 'testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,354 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,354 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 35c49d2dfa905e03084d83b93e20035d, disabling compactions & flushes 2023-02-11 19:03:18,354 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,354 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,354 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. after waiting 0 ms 2023-02-11 19:03:18,354 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,354 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,355 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 35c49d2dfa905e03084d83b93e20035d: Waiting for close lock at 1676142198354Disabling compacts and flushes for region at 1676142198354Disabling writes for close at 1676142198354Writing region close event to WAL at 1676142198354Closed at 1676142198354 2023-02-11 19:03:18,355 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7ea9b3a72b6b06849cb7fb1b8566b010, NAME => 'testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,355 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c126b1c0300e95aceccfe332563e63fc, disabling compactions & flushes 2023-02-11 19:03:18,356 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. after waiting 0 ms 2023-02-11 19:03:18,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c126b1c0300e95aceccfe332563e63fc: Waiting for close lock at 1676142198356Disabling compacts and flushes for region at 1676142198356Disabling writes for close at 1676142198356Writing region close event to WAL at 1676142198357 (+1 ms)Closed at 1676142198357 2023-02-11 19:03:18,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e7d22cb62b4f117de686c016c1009e59, NAME => 'testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,359 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1b17bd65213dcae81dbc9ac62b8fb31b, disabling compactions & flushes 2023-02-11 19:03:18,359 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:18,359 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:18,359 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. after waiting 0 ms 2023-02-11 19:03:18,359 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:18,359 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:18,359 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1b17bd65213dcae81dbc9ac62b8fb31b: Waiting for close lock at 1676142198359Disabling compacts and flushes for region at 1676142198359Disabling writes for close at 1676142198359Writing region close event to WAL at 1676142198359Closed at 1676142198359 2023-02-11 19:03:18,360 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc84fe42b2a24d860ba23bb2a186feb9, NAME => 'testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,390 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fc84fe42b2a24d860ba23bb2a186feb9, disabling compactions & flushes 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7ea9b3a72b6b06849cb7fb1b8566b010, disabling compactions & flushes 2023-02-11 19:03:18,391 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e7d22cb62b4f117de686c016c1009e59, disabling compactions & flushes 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:18,391 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. after waiting 0 ms 2023-02-11 19:03:18,391 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:18,391 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fc84fe42b2a24d860ba23bb2a186feb9: Waiting for close lock at 1676142198391Disabling compacts and flushes for region at 1676142198391Disabling writes for close at 1676142198391Writing region close event to WAL at 1676142198391Closed at 1676142198391 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. after waiting 0 ms 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. after waiting 0 ms 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:18,391 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:18,391 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:18,392 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:18,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7ea9b3a72b6b06849cb7fb1b8566b010: Waiting for close lock at 1676142198391Disabling compacts and flushes for region at 1676142198391Disabling writes for close at 1676142198391Writing region close event to WAL at 1676142198391Closed at 1676142198391 2023-02-11 19:03:18,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e7d22cb62b4f117de686c016c1009e59: Waiting for close lock at 1676142198391Disabling compacts and flushes for region at 1676142198391Disabling writes for close at 1676142198391Writing region close event to WAL at 1676142198392 (+1 ms)Closed at 1676142198392 2023-02-11 19:03:18,392 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4ec29956dad592ee8609bdd43ea1772f, NAME => 'testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,392 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d046f904075ae6356fed6a66a08c65ef, NAME => 'testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,393 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 576999b94045f2277f1a4af5553fcbd7, NAME => 'testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,443 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,443 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d046f904075ae6356fed6a66a08c65ef, disabling compactions & flushes 2023-02-11 19:03:18,443 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,443 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,443 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. after waiting 0 ms 2023-02-11 19:03:18,444 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,444 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,444 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d046f904075ae6356fed6a66a08c65ef: Waiting for close lock at 1676142198443Disabling compacts and flushes for region at 1676142198443Disabling writes for close at 1676142198444 (+1 ms)Writing region close event to WAL at 1676142198444Closed at 1676142198444 2023-02-11 19:03:18,445 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 44ab9974e56c847afc9182f62f5816e5, NAME => 'testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp 2023-02-11 19:03:18,447 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,448 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4ec29956dad592ee8609bdd43ea1772f, disabling compactions & flushes 2023-02-11 19:03:18,448 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,448 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,448 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. after waiting 0 ms 2023-02-11 19:03:18,448 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,448 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,448 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4ec29956dad592ee8609bdd43ea1772f: Waiting for close lock at 1676142198448Disabling compacts and flushes for region at 1676142198448Disabling writes for close at 1676142198448Writing region close event to WAL at 1676142198448Closed at 1676142198448 2023-02-11 19:03:18,450 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,450 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 576999b94045f2277f1a4af5553fcbd7, disabling compactions & flushes 2023-02-11 19:03:18,450 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:18,450 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:18,451 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. after waiting 0 ms 2023-02-11 19:03:18,451 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:18,451 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:18,451 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 576999b94045f2277f1a4af5553fcbd7: Waiting for close lock at 1676142198450Disabling compacts and flushes for region at 1676142198450Disabling writes for close at 1676142198451 (+1 ms)Writing region close event to WAL at 1676142198451Closed at 1676142198451 2023-02-11 19:03:18,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:18,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 44ab9974e56c847afc9182f62f5816e5, disabling compactions & flushes 2023-02-11 19:03:18,462 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:18,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:18,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. after waiting 0 ms 2023-02-11 19:03:18,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:18,462 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:18,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 44ab9974e56c847afc9182f62f5816e5: Waiting for close lock at 1676142198462Disabling compacts and flushes for region at 1676142198462Disabling writes for close at 1676142198462Writing region close event to WAL at 1676142198462Closed at 1676142198462 2023-02-11 19:03:18,468 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:18,470 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,470 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,470 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,472 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,472 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142198469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142198469"}]},"ts":"1676142198469"} 2023-02-11 19:03:18,521 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 19:03:18,523 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:18,524 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142198523"}]},"ts":"1676142198523"} 2023-02-11 19:03:18,526 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 19:03:18,531 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:18,548 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:18,548 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:18,548 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:18,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, ASSIGN}] 2023-02-11 19:03:18,553 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, ASSIGN 2023-02-11 19:03:18,553 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, ASSIGN 2023-02-11 19:03:18,554 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, ASSIGN 2023-02-11 19:03:18,554 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, ASSIGN 2023-02-11 19:03:18,556 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45665,1676142194807; forceNewPlan=false, retain=false 2023-02-11 19:03:18,556 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45665,1676142194807; forceNewPlan=false, retain=false 2023-02-11 19:03:18,556 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45665,1676142194807; forceNewPlan=false, retain=false 2023-02-11 19:03:18,556 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46149,1676142194856; forceNewPlan=false, retain=false 2023-02-11 19:03:18,556 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, ASSIGN 2023-02-11 19:03:18,558 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, ASSIGN 2023-02-11 19:03:18,558 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, ASSIGN 2023-02-11 19:03:18,558 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46149,1676142194856; forceNewPlan=false, retain=false 2023-02-11 19:03:18,558 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, ASSIGN 2023-02-11 19:03:18,559 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, ASSIGN 2023-02-11 19:03:18,560 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45665,1676142194807; forceNewPlan=false, retain=false 2023-02-11 19:03:18,560 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45665,1676142194807; forceNewPlan=false, retain=false 2023-02-11 19:03:18,560 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, ASSIGN 2023-02-11 19:03:18,561 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46149,1676142194856; forceNewPlan=false, retain=false 2023-02-11 19:03:18,561 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46149,1676142194856; forceNewPlan=false, retain=false 2023-02-11 19:03:18,562 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46149,1676142194856; forceNewPlan=false, retain=false 2023-02-11 19:03:18,706 INFO [jenkins-hbase4:35183] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 19:03:18,710 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c126b1c0300e95aceccfe332563e63fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,710 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e7d22cb62b4f117de686c016c1009e59, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4ec29956dad592ee8609bdd43ea1772f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,710 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=44ab9974e56c847afc9182f62f5816e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,711 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fc84fe42b2a24d860ba23bb2a186feb9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,711 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198710"}]},"ts":"1676142198710"} 2023-02-11 19:03:18,711 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142198710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198710"}]},"ts":"1676142198710"} 2023-02-11 19:03:18,711 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198710"}]},"ts":"1676142198710"} 2023-02-11 19:03:18,711 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198710"}]},"ts":"1676142198710"} 2023-02-11 19:03:18,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198711"}]},"ts":"1676142198711"} 2023-02-11 19:03:18,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 44ab9974e56c847afc9182f62f5816e5, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:18,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure c126b1c0300e95aceccfe332563e63fc, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:18,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure e7d22cb62b4f117de686c016c1009e59, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:18,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure fc84fe42b2a24d860ba23bb2a186feb9, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:18,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 4ec29956dad592ee8609bdd43ea1772f, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:18,724 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=d046f904075ae6356fed6a66a08c65ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,724 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198724"}]},"ts":"1676142198724"} 2023-02-11 19:03:18,725 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=576999b94045f2277f1a4af5553fcbd7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,725 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198725"}]},"ts":"1676142198725"} 2023-02-11 19:03:18,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure d046f904075ae6356fed6a66a08c65ef, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:18,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7ea9b3a72b6b06849cb7fb1b8566b010, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=35c49d2dfa905e03084d83b93e20035d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198728"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198728"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198728"}]},"ts":"1676142198728"} 2023-02-11 19:03:18,729 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198728"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198728"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198728"}]},"ts":"1676142198728"} 2023-02-11 19:03:18,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 576999b94045f2277f1a4af5553fcbd7, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:18,730 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1b17bd65213dcae81dbc9ac62b8fb31b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,731 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142198730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142198730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142198730"}]},"ts":"1676142198730"} 2023-02-11 19:03:18,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 7ea9b3a72b6b06849cb7fb1b8566b010, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:18,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 35c49d2dfa905e03084d83b93e20035d, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:18,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 1b17bd65213dcae81dbc9ac62b8fb31b, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:18,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ec29956dad592ee8609bdd43ea1772f, NAME => 'testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 19:03:18,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,889 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,891 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1 2023-02-11 19:03:18,891 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1 2023-02-11 19:03:18,892 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ec29956dad592ee8609bdd43ea1772f columnFamilyName f1 2023-02-11 19:03:18,893 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(310): Store=4ec29956dad592ee8609bdd43ea1772f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,893 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,901 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2 2023-02-11 19:03:18,902 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2 2023-02-11 19:03:18,902 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ec29956dad592ee8609bdd43ea1772f columnFamilyName f2 2023-02-11 19:03:18,903 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(310): Store=4ec29956dad592ee8609bdd43ea1772f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d046f904075ae6356fed6a66a08c65ef, NAME => 'testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 19:03:18,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,910 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:18,912 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1 2023-02-11 19:03:18,912 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1 2023-02-11 19:03:18,912 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d046f904075ae6356fed6a66a08c65ef columnFamilyName f1 2023-02-11 19:03:18,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:18,913 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(310): Store=d046f904075ae6356fed6a66a08c65ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,914 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,916 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2 2023-02-11 19:03:18,916 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2 2023-02-11 19:03:18,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:18,916 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d046f904075ae6356fed6a66a08c65ef columnFamilyName f2 2023-02-11 19:03:18,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4ec29956dad592ee8609bdd43ea1772f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64228393, jitterRate=-0.04292236268520355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:18,917 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(310): Store=d046f904075ae6356fed6a66a08c65ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4ec29956dad592ee8609bdd43ea1772f: Running coprocessor pre-open hook at 1676142198876Writing region info on filesystem at 1676142198876Initializing all the Stores at 1676142198888 (+12 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198888Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198888Cleaning up temporary data from old regions at 1676142198909 (+21 ms)Cleaning up detritus from prior splits at 1676142198910 (+1 ms)Running coprocessor post-open hooks at 1676142198917 (+7 ms)Region opened successfully at 1676142198917 2023-02-11 19:03:18,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f., pid=25, masterSystemTime=1676142198868 2023-02-11 19:03:18,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:18,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c126b1c0300e95aceccfe332563e63fc, NAME => 'testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 19:03:18,924 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4ec29956dad592ee8609bdd43ea1772f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,924 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198924"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142198924"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142198924"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142198924"}]},"ts":"1676142198924"} 2023-02-11 19:03:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:18,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:18,930 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:18,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d046f904075ae6356fed6a66a08c65ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64216338, jitterRate=-0.043101996183395386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:18,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d046f904075ae6356fed6a66a08c65ef: Running coprocessor pre-open hook at 1676142198908Writing region info on filesystem at 1676142198908Initializing all the Stores at 1676142198909 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198909Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198909Cleaning up temporary data from old regions at 1676142198922 (+13 ms)Cleaning up detritus from prior splits at 1676142198923 (+1 ms)Running coprocessor post-open hooks at 1676142198932 (+9 ms)Region opened successfully at 1676142198932 2023-02-11 19:03:18,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef., pid=26, masterSystemTime=1676142198892 2023-02-11 19:03:18,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:18,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 35c49d2dfa905e03084d83b93e20035d, NAME => 'testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 19:03:18,937 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=d046f904075ae6356fed6a66a08c65ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,938 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142198937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142198937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142198937"}]},"ts":"1676142198937"} 2023-02-11 19:03:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-11 19:03:18,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 4ec29956dad592ee8609bdd43ea1772f, server=jenkins-hbase4.apache.org,46149,1676142194856 in 206 msec 2023-02-11 19:03:18,941 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1 2023-02-11 19:03:18,941 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1 2023-02-11 19:03:18,942 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,942 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c126b1c0300e95aceccfe332563e63fc columnFamilyName f1 2023-02-11 19:03:18,943 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(310): Store=c126b1c0300e95aceccfe332563e63fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,943 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, ASSIGN in 391 msec 2023-02-11 19:03:18,945 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1 2023-02-11 19:03:18,945 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1 2023-02-11 19:03:18,946 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35c49d2dfa905e03084d83b93e20035d columnFamilyName f1 2023-02-11 19:03:18,946 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2 2023-02-11 19:03:18,946 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2 2023-02-11 19:03:18,946 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c126b1c0300e95aceccfe332563e63fc columnFamilyName f2 2023-02-11 19:03:18,947 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(310): Store=35c49d2dfa905e03084d83b93e20035d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-11 19:03:18,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure d046f904075ae6356fed6a66a08c65ef, server=jenkins-hbase4.apache.org,45665,1676142194807 in 214 msec 2023-02-11 19:03:18,949 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(310): Store=c126b1c0300e95aceccfe332563e63fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,949 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, ASSIGN in 399 msec 2023-02-11 19:03:18,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,952 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2 2023-02-11 19:03:18,952 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2 2023-02-11 19:03:18,954 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35c49d2dfa905e03084d83b93e20035d columnFamilyName f2 2023-02-11 19:03:18,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:18,955 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(310): Store=35c49d2dfa905e03084d83b93e20035d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:18,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:18,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:18,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:18,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c126b1c0300e95aceccfe332563e63fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61508670, jitterRate=-0.08344939351081848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:18,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c126b1c0300e95aceccfe332563e63fc: Running coprocessor pre-open hook at 1676142198925Writing region info on filesystem at 1676142198925Initializing all the Stores at 1676142198927 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198927Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198930 (+3 ms)Cleaning up temporary data from old regions at 1676142198953 (+23 ms)Cleaning up detritus from prior splits at 1676142198953Running coprocessor post-open hooks at 1676142198970 (+17 ms)Region opened successfully at 1676142198970 2023-02-11 19:03:18,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc., pid=22, masterSystemTime=1676142198868 2023-02-11 19:03:18,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:18,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:18,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:18,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:18,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc84fe42b2a24d860ba23bb2a186feb9, NAME => 'testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 19:03:18,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 35c49d2dfa905e03084d83b93e20035d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60721473, jitterRate=-0.09517954289913177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:18,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 35c49d2dfa905e03084d83b93e20035d: Running coprocessor pre-open hook at 1676142198938Writing region info on filesystem at 1676142198938Initializing all the Stores at 1676142198941 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198941Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198942 (+1 ms)Cleaning up temporary data from old regions at 1676142198959 (+17 ms)Cleaning up detritus from prior splits at 1676142198962 (+3 ms)Running coprocessor post-open hooks at 1676142198977 (+15 ms)Region opened successfully at 1676142198977 2023-02-11 19:03:18,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c126b1c0300e95aceccfe332563e63fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:18,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,978 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198976"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142198976"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142198976"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142198976"}]},"ts":"1676142198976"} 2023-02-11 19:03:18,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d., pid=29, masterSystemTime=1676142198892 2023-02-11 19:03:18,982 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:18,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:18,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b17bd65213dcae81dbc9ac62b8fb31b, NAME => 'testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 19:03:18,983 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=35c49d2dfa905e03084d83b93e20035d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:18,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:18,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:18,983 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142198983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142198983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142198983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142198983"}]},"ts":"1676142198983"} 2023-02-11 19:03:18,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:18,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:18,986 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1 2023-02-11 19:03:18,986 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1 2023-02-11 19:03:18,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-11 19:03:18,986 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:18,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure c126b1c0300e95aceccfe332563e63fc, server=jenkins-hbase4.apache.org,46149,1676142194856 in 266 msec 2023-02-11 19:03:18,987 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc84fe42b2a24d860ba23bb2a186feb9 columnFamilyName f1 2023-02-11 19:03:18,988 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(310): Store=fc84fe42b2a24d860ba23bb2a186feb9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,989 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,989 DEBUG [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f1 2023-02-11 19:03:18,990 DEBUG [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f1 2023-02-11 19:03:18,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, ASSIGN in 438 msec 2023-02-11 19:03:18,990 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b17bd65213dcae81dbc9ac62b8fb31b columnFamilyName f1 2023-02-11 19:03:18,991 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2 2023-02-11 19:03:18,991 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2 2023-02-11 19:03:18,992 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc84fe42b2a24d860ba23bb2a186feb9 columnFamilyName f2 2023-02-11 19:03:18,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-11 19:03:18,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 35c49d2dfa905e03084d83b93e20035d, server=jenkins-hbase4.apache.org,45665,1676142194807 in 253 msec 2023-02-11 19:03:18,994 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(310): Store=fc84fe42b2a24d860ba23bb2a186feb9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, ASSIGN in 444 msec 2023-02-11 19:03:18,995 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(310): Store=1b17bd65213dcae81dbc9ac62b8fb31b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:18,995 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:18,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:18,997 DEBUG [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f2 2023-02-11 19:03:18,997 DEBUG [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f2 2023-02-11 19:03:18,998 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b17bd65213dcae81dbc9ac62b8fb31b columnFamilyName f2 2023-02-11 19:03:18,999 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(310): Store=1b17bd65213dcae81dbc9ac62b8fb31b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:19,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:19,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:19,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:19,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:19,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:19,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:19,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:19,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fc84fe42b2a24d860ba23bb2a186feb9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68069712, jitterRate=0.014317750930786133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:19,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fc84fe42b2a24d860ba23bb2a186feb9: Running coprocessor pre-open hook at 1676142198979Writing region info on filesystem at 1676142198979Initializing all the Stores at 1676142198980 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198981 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198981Cleaning up temporary data from old regions at 1676142198998 (+17 ms)Cleaning up detritus from prior splits at 1676142198999 (+1 ms)Running coprocessor post-open hooks at 1676142199011 (+12 ms)Region opened successfully at 1676142199011 2023-02-11 19:03:19,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9., pid=24, masterSystemTime=1676142198868 2023-02-11 19:03:19,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1b17bd65213dcae81dbc9ac62b8fb31b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58918355, jitterRate=-0.12204809486865997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1b17bd65213dcae81dbc9ac62b8fb31b: Running coprocessor pre-open hook at 1676142198984Writing region info on filesystem at 1676142198984Initializing all the Stores at 1676142198985 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198985Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142198986 (+1 ms)Cleaning up temporary data from old regions at 1676142199002 (+16 ms)Cleaning up detritus from prior splits at 1676142199003 (+1 ms)Running coprocessor post-open hooks at 1676142199015 (+12 ms)Region opened successfully at 1676142199015 2023-02-11 19:03:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:19,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:19,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:19,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e7d22cb62b4f117de686c016c1009e59, NAME => 'testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 19:03:19,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:19,016 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fc84fe42b2a24d860ba23bb2a186feb9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:19,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,016 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142199016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142199016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142199016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142199016"}]},"ts":"1676142199016"} 2023-02-11 19:03:19,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b., pid=30, masterSystemTime=1676142198892 2023-02-11 19:03:19,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:19,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:19,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:19,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7ea9b3a72b6b06849cb7fb1b8566b010, NAME => 'testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 19:03:19,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:19,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,022 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1b17bd65213dcae81dbc9ac62b8fb31b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:19,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142199022"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142199022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142199022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142199022"}]},"ts":"1676142199022"} 2023-02-11 19:03:19,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-11 19:03:19,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure fc84fe42b2a24d860ba23bb2a186feb9, server=jenkins-hbase4.apache.org,46149,1676142194856 in 300 msec 2023-02-11 19:03:19,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, ASSIGN in 477 msec 2023-02-11 19:03:19,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-11 19:03:19,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 1b17bd65213dcae81dbc9ac62b8fb31b, server=jenkins-hbase4.apache.org,45665,1676142194807 in 291 msec 2023-02-11 19:03:19,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, ASSIGN in 481 msec 2023-02-11 19:03:19,036 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,036 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,039 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1 2023-02-11 19:03:19,039 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1 2023-02-11 19:03:19,039 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1 2023-02-11 19:03:19,039 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1 2023-02-11 19:03:19,039 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7d22cb62b4f117de686c016c1009e59 columnFamilyName f1 2023-02-11 19:03:19,039 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ea9b3a72b6b06849cb7fb1b8566b010 columnFamilyName f1 2023-02-11 19:03:19,040 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(310): Store=e7d22cb62b4f117de686c016c1009e59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,040 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,040 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(310): Store=7ea9b3a72b6b06849cb7fb1b8566b010/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,041 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,042 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2 2023-02-11 19:03:19,043 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2 2023-02-11 19:03:19,043 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2 2023-02-11 19:03:19,043 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2 2023-02-11 19:03:19,043 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7d22cb62b4f117de686c016c1009e59 columnFamilyName f2 2023-02-11 19:03:19,043 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ea9b3a72b6b06849cb7fb1b8566b010 columnFamilyName f2 2023-02-11 19:03:19,044 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(310): Store=e7d22cb62b4f117de686c016c1009e59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,044 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(310): Store=7ea9b3a72b6b06849cb7fb1b8566b010/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:19,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:19,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:19,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:19,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7ea9b3a72b6b06849cb7fb1b8566b010; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63015970, jitterRate=-0.06098887324333191}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:19,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7ea9b3a72b6b06849cb7fb1b8566b010: Running coprocessor pre-open hook at 1676142199022Writing region info on filesystem at 1676142199022Initializing all the Stores at 1676142199024 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199024Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199036 (+12 ms)Cleaning up temporary data from old regions at 1676142199048 (+12 ms)Cleaning up detritus from prior splits at 1676142199049 (+1 ms)Running coprocessor post-open hooks at 1676142199058 (+9 ms)Region opened successfully at 1676142199058 2023-02-11 19:03:19,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:19,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010., pid=28, masterSystemTime=1676142198892 2023-02-11 19:03:19,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:19,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:19,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:19,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:19,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 576999b94045f2277f1a4af5553fcbd7, NAME => 'testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 19:03:19,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e7d22cb62b4f117de686c016c1009e59; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62353012, jitterRate=-0.07086771726608276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:19,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e7d22cb62b4f117de686c016c1009e59: Running coprocessor pre-open hook at 1676142199016Writing region info on filesystem at 1676142199016Initializing all the Stores at 1676142199019 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199019Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199036 (+17 ms)Cleaning up temporary data from old regions at 1676142199048 (+12 ms)Cleaning up detritus from prior splits at 1676142199049 (+1 ms)Running coprocessor post-open hooks at 1676142199063 (+14 ms)Region opened successfully at 1676142199063 2023-02-11 19:03:19,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:19,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,064 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7ea9b3a72b6b06849cb7fb1b8566b010, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:19,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142199064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142199064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142199064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142199064"}]},"ts":"1676142199064"} 2023-02-11 19:03:19,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59., pid=23, masterSystemTime=1676142198868 2023-02-11 19:03:19,066 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:19,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:19,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:19,068 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1 2023-02-11 19:03:19,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 44ab9974e56c847afc9182f62f5816e5, NAME => 'testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 19:03:19,068 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1 2023-02-11 19:03:19,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:19,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,069 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 576999b94045f2277f1a4af5553fcbd7 columnFamilyName f1 2023-02-11 19:03:19,070 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e7d22cb62b4f117de686c016c1009e59, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:19,070 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142199070"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142199070"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142199070"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142199070"}]},"ts":"1676142199070"} 2023-02-11 19:03:19,071 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(310): Store=576999b94045f2277f1a4af5553fcbd7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,071 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,071 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-11 19:03:19,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 7ea9b3a72b6b06849cb7fb1b8566b010, server=jenkins-hbase4.apache.org,45665,1676142194807 in 335 msec 2023-02-11 19:03:19,075 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2 2023-02-11 19:03:19,075 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2 2023-02-11 19:03:19,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, ASSIGN in 524 msec 2023-02-11 19:03:19,076 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 576999b94045f2277f1a4af5553fcbd7 columnFamilyName f2 2023-02-11 19:03:19,076 DEBUG [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f1 2023-02-11 19:03:19,076 DEBUG [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f1 2023-02-11 19:03:19,076 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44ab9974e56c847afc9182f62f5816e5 columnFamilyName f1 2023-02-11 19:03:19,077 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(310): Store=576999b94045f2277f1a4af5553fcbd7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-11 19:03:19,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure e7d22cb62b4f117de686c016c1009e59, server=jenkins-hbase4.apache.org,46149,1676142194856 in 355 msec 2023-02-11 19:03:19,078 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(310): Store=44ab9974e56c847afc9182f62f5816e5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,078 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, ASSIGN in 529 msec 2023-02-11 19:03:19,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,081 DEBUG [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f2 2023-02-11 19:03:19,081 DEBUG [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f2 2023-02-11 19:03:19,081 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44ab9974e56c847afc9182f62f5816e5 columnFamilyName f2 2023-02-11 19:03:19,082 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(310): Store=44ab9974e56c847afc9182f62f5816e5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:19,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:19,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:19,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:19,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:19,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:19,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 576999b94045f2277f1a4af5553fcbd7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71769663, jitterRate=0.06945131719112396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:19,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 576999b94045f2277f1a4af5553fcbd7: Running coprocessor pre-open hook at 1676142199064Writing region info on filesystem at 1676142199064Initializing all the Stores at 1676142199065 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199065Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199065Cleaning up temporary data from old regions at 1676142199082 (+17 ms)Cleaning up detritus from prior splits at 1676142199084 (+2 ms)Running coprocessor post-open hooks at 1676142199091 (+7 ms)Region opened successfully at 1676142199091 2023-02-11 19:03:19,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:19,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7., pid=27, masterSystemTime=1676142198892 2023-02-11 19:03:19,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 44ab9974e56c847afc9182f62f5816e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72258679, jitterRate=0.07673822343349457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:19,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 44ab9974e56c847afc9182f62f5816e5: Running coprocessor pre-open hook at 1676142199069Writing region info on filesystem at 1676142199069Initializing all the Stores at 1676142199070 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199071 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142199071Cleaning up temporary data from old regions at 1676142199085 (+14 ms)Cleaning up detritus from prior splits at 1676142199086 (+1 ms)Running coprocessor post-open hooks at 1676142199093 (+7 ms)Region opened successfully at 1676142199093 2023-02-11 19:03:19,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5., pid=21, masterSystemTime=1676142198868 2023-02-11 19:03:19,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:19,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:19,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=576999b94045f2277f1a4af5553fcbd7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:19,097 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142199096"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142199096"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142199096"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142199096"}]},"ts":"1676142199096"} 2023-02-11 19:03:19,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:19,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:19,098 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=44ab9974e56c847afc9182f62f5816e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:19,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142199098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142199098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142199098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142199098"}]},"ts":"1676142199098"} 2023-02-11 19:03:19,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-11 19:03:19,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 576999b94045f2277f1a4af5553fcbd7, server=jenkins-hbase4.apache.org,45665,1676142194807 in 370 msec 2023-02-11 19:03:19,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-11 19:03:19,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 44ab9974e56c847afc9182f62f5816e5, server=jenkins-hbase4.apache.org,46149,1676142194856 in 386 msec 2023-02-11 19:03:19,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, ASSIGN in 555 msec 2023-02-11 19:03:19,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-11 19:03:19,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, ASSIGN in 557 msec 2023-02-11 19:03:19,110 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:19,110 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142199110"}]},"ts":"1676142199110"} 2023-02-11 19:03:19,112 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 19:03:19,115 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:19,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.3050 sec 2023-02-11 19:03:19,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:19,959 INFO [Listener at localhost/37527] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 19:03:19,959 DEBUG [Listener at localhost/37527] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 19:03:19,962 INFO [Listener at localhost/37527] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:19,970 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 19:03:19,971 INFO [Listener at localhost/37527] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:19,971 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 19:03:19,971 INFO [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:03:20,113 DEBUG [hconnection-0x28707e63-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:20,189 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49248, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:20,234 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46149] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:20,234 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45665] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:20,569 INFO [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:03:20,573 INFO [Listener at localhost/37527] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:03:20,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:03:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142200587 (current time:1676142200587). 2023-02-11 19:03:20,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:03:20,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] zookeeper.ReadOnlyZKClient(139): Connect 0x51985b3a to 127.0.0.1:59241 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:20,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd63749, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:20,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:20,602 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:20,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51985b3a to 127.0.0.1:59241 2023-02-11 19:03:20,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:20,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:03:20,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:03:20,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:03:20,628 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:03:20,630 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676142800630 2023-02-11 19:03:20,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:03:20,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 19:03:20,633 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:03:20,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:03:20,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 13 msec 2023-02-11 19:03:20,637 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:03:20,637 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:20,637 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:03:20,638 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676142800638 2023-02-11 19:03:20,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-11 19:03:20,721 INFO [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-11 19:03:20,721 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:20,721 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-11 19:03:20,722 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 19:03:20,726 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:20,726 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:20,729 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:20,729 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,729 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:20,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:20,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:20,729 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,730 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:20,731 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,731 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:20,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:20,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-11 19:03:20,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:20,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:20,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 19:03:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-11 19:03:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:20,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 19:03:20,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-11 19:03:20,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-11 19:03:20,737 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-11 19:03:20,737 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:20,738 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 19:03:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-11 19:03:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-11 19:03:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46149,1676142194856' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-11 19:03:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 19:03:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-11 19:03:20,740 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45665,1676142194807' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-11 19:03:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:20,743 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,743 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:20,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:20,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:20,744 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,744 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:20,745 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,745 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:20,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:20,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45665,1676142194807' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-11 19:03:20,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f594e0[Count = 1] remaining members to acquire global barrier 2023-02-11 19:03:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,748 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:20,748 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:03:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:20,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46149,1676142194856' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-11 19:03:20,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f594e0[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:20,752 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 19:03:20,752 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,754 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,754 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:20,755 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:20,755 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:20,755 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:20,756 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:20,757 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:20,758 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. started... 2023-02-11 19:03:20,760 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c126b1c0300e95aceccfe332563e63fc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:20,764 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:20,764 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. started... 2023-02-11 19:03:20,764 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:20,764 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. started... 2023-02-11 19:03:20,765 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 19:03:20,765 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:20,765 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:20,765 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. started... 2023-02-11 19:03:20,768 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e7d22cb62b4f117de686c016c1009e59 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:20,769 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1b17bd65213dcae81dbc9ac62b8fb31b: 2023-02-11 19:03:20,770 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:20,772 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4ec29956dad592ee8609bdd43ea1772f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:20,775 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:20,776 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 19:03:20,776 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:20,776 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:20,776 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. started... 2023-02-11 19:03:20,777 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:20,777 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7ea9b3a72b6b06849cb7fb1b8566b010 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:20,778 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. started... 2023-02-11 19:03:20,780 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 35c49d2dfa905e03084d83b93e20035d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 19:03:20,784 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:20,784 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:20,848 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. completed. 2023-02-11 19:03:20,848 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:20,849 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:20,849 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 19:03:20,849 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. started... 2023-02-11 19:03:20,850 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d046f904075ae6356fed6a66a08c65ef 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:20,948 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:20,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:20,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:20,951 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:03:21,052 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7 2023-02-11 19:03:21,054 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f1/a66a7e8b010d4b3bb64331c491eb34be 2023-02-11 19:03:21,063 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f1/36a62f990d3442f69e758a33d66b849f 2023-02-11 19:03:21,078 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f1/f28f234237d048298683d692af7bdcac 2023-02-11 19:03:21,079 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f1/690fb0b127514915b5959e14c44114a0 2023-02-11 19:03:21,082 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f1/2f547555246f429a96ae27109f27bede 2023-02-11 19:03:21,201 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f2/f5cf82d474544c029ecd03fb02b111ad 2023-02-11 19:03:21,212 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f1/690fb0b127514915b5959e14c44114a0 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/690fb0b127514915b5959e14c44114a0 2023-02-11 19:03:21,241 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/690fb0b127514915b5959e14c44114a0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,244 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61 2023-02-11 19:03:21,245 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f2/f5cf82d474544c029ecd03fb02b111ad as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/f5cf82d474544c029ecd03fb02b111ad 2023-02-11 19:03:21,252 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:21,252 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f2/e3d2aba2007f4f4e8631685ca141c487 2023-02-11 19:03:21,253 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f2/fd00a0d79b7d40f1a02062d5c9c083fa 2023-02-11 19:03:21,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:21,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:21,255 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 19:03:21,256 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f2/676c8ed7236b49cf9aece7c831e919e9 2023-02-11 19:03:21,257 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f2/513f365d6a7a4f609460f7cc871fe413 2023-02-11 19:03:21,259 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/f5cf82d474544c029ecd03fb02b111ad, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7 2023-02-11 19:03:21,261 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c126b1c0300e95aceccfe332563e63fc in 501ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,263 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 19:03:21,267 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c126b1c0300e95aceccfe332563e63fc: 2023-02-11 19:03:21,268 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,268 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,268 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/690fb0b127514915b5959e14c44114a0] hfiles 2023-02-11 19:03:21,268 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f1/f28f234237d048298683d692af7bdcac as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/f28f234237d048298683d692af7bdcac 2023-02-11 19:03:21,268 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/690fb0b127514915b5959e14c44114a0 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,268 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f1/2f547555246f429a96ae27109f27bede as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/2f547555246f429a96ae27109f27bede 2023-02-11 19:03:21,269 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f1/a66a7e8b010d4b3bb64331c491eb34be as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/a66a7e8b010d4b3bb64331c491eb34be 2023-02-11 19:03:21,270 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f1/36a62f990d3442f69e758a33d66b849f as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/36a62f990d3442f69e758a33d66b849f 2023-02-11 19:03:21,273 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/f5cf82d474544c029ecd03fb02b111ad] hfiles 2023-02-11 19:03:21,273 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/f5cf82d474544c029ecd03fb02b111ad for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,274 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:21,276 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61 2023-02-11 19:03:21,279 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/f28f234237d048298683d692af7bdcac, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,282 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f2/fd00a0d79b7d40f1a02062d5c9c083fa as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/fd00a0d79b7d40f1a02062d5c9c083fa 2023-02-11 19:03:21,284 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/a66a7e8b010d4b3bb64331c491eb34be, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,284 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/36a62f990d3442f69e758a33d66b849f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,286 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f2/513f365d6a7a4f609460f7cc871fe413 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/513f365d6a7a4f609460f7cc871fe413 2023-02-11 19:03:21,286 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f2/676c8ed7236b49cf9aece7c831e919e9 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/676c8ed7236b49cf9aece7c831e919e9 2023-02-11 19:03:21,288 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/2f547555246f429a96ae27109f27bede, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,291 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f2/e3d2aba2007f4f4e8631685ca141c487 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/e3d2aba2007f4f4e8631685ca141c487 2023-02-11 19:03:21,299 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:21,300 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 35c49d2dfa905e03084d83b93e20035d in 522ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,302 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/676c8ed7236b49cf9aece7c831e919e9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,303 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/e3d2aba2007f4f4e8631685ca141c487, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,303 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d046f904075ae6356fed6a66a08c65ef in 453ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,304 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7ea9b3a72b6b06849cb7fb1b8566b010 in 527ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,308 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 35c49d2dfa905e03084d83b93e20035d: 2023-02-11 19:03:21,308 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7ea9b3a72b6b06849cb7fb1b8566b010: 2023-02-11 19:03:21,308 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d046f904075ae6356fed6a66a08c65ef: 2023-02-11 19:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,309 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/2f547555246f429a96ae27109f27bede] hfiles 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/36a62f990d3442f69e758a33d66b849f] hfiles 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/2f547555246f429a96ae27109f27bede for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7] hfiles 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/36a62f990d3442f69e758a33d66b849f for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/e3d2aba2007f4f4e8631685ca141c487] hfiles 2023-02-11 19:03:21,311 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61] hfiles 2023-02-11 19:03:21,311 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,311 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/e3d2aba2007f4f4e8631685ca141c487 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,310 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/676c8ed7236b49cf9aece7c831e919e9] hfiles 2023-02-11 19:03:21,311 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/676c8ed7236b49cf9aece7c831e919e9 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,311 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/fd00a0d79b7d40f1a02062d5c9c083fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,311 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/513f365d6a7a4f609460f7cc871fe413, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,312 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4ec29956dad592ee8609bdd43ea1772f in 540ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,312 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e7d22cb62b4f117de686c016c1009e59 in 544ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,312 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4ec29956dad592ee8609bdd43ea1772f: 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e7d22cb62b4f117de686c016c1009e59: 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/a66a7e8b010d4b3bb64331c491eb34be] hfiles 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/a66a7e8b010d4b3bb64331c491eb34be for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/513f365d6a7a4f609460f7cc871fe413] hfiles 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/513f365d6a7a4f609460f7cc871fe413 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,313 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,314 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/f28f234237d048298683d692af7bdcac] hfiles 2023-02-11 19:03:21,314 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/f28f234237d048298683d692af7bdcac for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,314 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/fd00a0d79b7d40f1a02062d5c9c083fa] hfiles 2023-02-11 19:03:21,314 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/fd00a0d79b7d40f1a02062d5c9c083fa for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,328 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. completed. 2023-02-11 19:03:21,328 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:21,328 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:21,328 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 19:03:21,328 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. started... 2023-02-11 19:03:21,332 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fc84fe42b2a24d860ba23bb2a186feb9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:21,371 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. completed. 2023-02-11 19:03:21,371 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:21,371 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:21,371 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. started... 2023-02-11 19:03:21,371 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 19:03:21,376 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. completed. 2023-02-11 19:03:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:21,380 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 19:03:21,379 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. completed. 2023-02-11 19:03:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 44ab9974e56c847afc9182f62f5816e5: 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. started... 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. completed. 2023-02-11 19:03:21,381 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,381 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:21,381 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:21,383 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 576999b94045f2277f1a4af5553fcbd7 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 19:03:21,396 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f1/627821d3aa054294afe734afb55a38f2 2023-02-11 19:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. completed. 2023-02-11 19:03:21,407 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:21,407 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 19:03:21,417 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f1/1098a10bf3a64035b086157c5e0a55e7 2023-02-11 19:03:21,444 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f2/fe1e8d26916f4678a00d361ca5c8a470 2023-02-11 19:03:21,454 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f1/1098a10bf3a64035b086157c5e0a55e7 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/1098a10bf3a64035b086157c5e0a55e7 2023-02-11 19:03:21,462 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/1098a10bf3a64035b086157c5e0a55e7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:21,464 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f2/fe1e8d26916f4678a00d361ca5c8a470 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/fe1e8d26916f4678a00d361ca5c8a470 2023-02-11 19:03:21,473 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/fe1e8d26916f4678a00d361ca5c8a470, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:21,475 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 576999b94045f2277f1a4af5553fcbd7 in 91ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 576999b94045f2277f1a4af5553fcbd7: 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/1098a10bf3a64035b086157c5e0a55e7] hfiles 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/1098a10bf3a64035b086157c5e0a55e7 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/fe1e8d26916f4678a00d361ca5c8a470] hfiles 2023-02-11 19:03:21,475 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/fe1e8d26916f4678a00d361ca5c8a470 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,486 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. completed. 2023-02-11 19:03:21,487 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 19:03:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 19:03:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-11 19:03:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45665,1676142194807' in zk 2023-02-11 19:03:21,492 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-11 19:03:21,492 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,492 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:21,492 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-11 19:03:21,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45665,1676142194807': 2023-02-11 19:03:21,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45665,1676142194807' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 19:03:21,755 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:21,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:21,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:21,757 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 19:03:21,772 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. completed. 2023-02-11 19:03:21,772 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:21,772 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 19:03:21,835 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f2/86ff2fc2ff4349dca432ee34e8613d50 2023-02-11 19:03:21,847 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f1/627821d3aa054294afe734afb55a38f2 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/627821d3aa054294afe734afb55a38f2 2023-02-11 19:03:21,857 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/627821d3aa054294afe734afb55a38f2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,858 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f2/86ff2fc2ff4349dca432ee34e8613d50 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/86ff2fc2ff4349dca432ee34e8613d50 2023-02-11 19:03:21,866 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/86ff2fc2ff4349dca432ee34e8613d50, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:21,868 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fc84fe42b2a24d860ba23bb2a186feb9 in 536ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fc84fe42b2a24d860ba23bb2a186feb9: 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/627821d3aa054294afe734afb55a38f2] hfiles 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/627821d3aa054294afe734afb55a38f2 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/86ff2fc2ff4349dca432ee34e8613d50] hfiles 2023-02-11 19:03:21,868 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/86ff2fc2ff4349dca432ee34e8613d50 for snapshot=testWithMapReduceMultiRegion 2023-02-11 19:03:21,877 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. completed. 2023-02-11 19:03:21,877 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 19:03:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 19:03:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-11 19:03:21,878 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46149,1676142194856' in zk 2023-02-11 19:03:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-11 19:03:21,880 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:21,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:21,880 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-11 19:03:21,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46149,1676142194856': 2023-02-11 19:03:21,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46149,1676142194856' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 19:03:21,885 INFO [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-11 19:03:21,885 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:21,885 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:21,885 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-11 19:03:21,885 INFO [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:03:21,887 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,887 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:21,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,887 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,888 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:21,888 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:21,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:21,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:21,889 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,890 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,892 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:21,893 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 19:03:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,908 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:21,908 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:21,908 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:21,908 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:21,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-11 19:03:21,908 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-11 19:03:21,909 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 19:03:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:21,908 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:21,908 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:21,909 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:21,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:21,910 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:21,910 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:21,910 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:21,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:21,910 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 19:03:21,910 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 19:03:21,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:21,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:21,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 19:03:21,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-11 19:03:22,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-11 19:03:22,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 19:03:22,015 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 19:03:22,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676142200631Consolidate snapshot: testWithMapReduceMultiRegion at 1676142201909 (+1278 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676142201909Writing data manifest for testWithMapReduceMultiRegion at 1676142201941 (+32 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676142201959 (+18 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676142202014 (+55 ms) 2023-02-11 19:03:22,016 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:03:22,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3830 sec 2023-02-11 19:03:22,233 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 19:03:22,299 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 19:03:22,300 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 19:03:22,757 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:22,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:22,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:03:22,759 INFO [Listener at localhost/37527] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:03:22,772 INFO [Listener at localhost/37527] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:03:22,782 INFO [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:03:22,837 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46149] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:22,844 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45665] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:22,980 INFO [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:03:22,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:03:23,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 19:03:23,000 INFO [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 19:03:23,000 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:23,001 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 19:03:23,001 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 19:03:23,002 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,002 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,003 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:23,003 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:23,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:23,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:23,003 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,004 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,005 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,005 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:23,005 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 19:03:23,005 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:23,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 19:03:23,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 19:03:23,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 19:03:23,012 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 19:03:23,012 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:23,012 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 19:03:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 19:03:23,013 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 19:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. started... 2023-02-11 19:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. started... 2023-02-11 19:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b17bd65213dcae81dbc9ac62b8fb31b: 2023-02-11 19:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:23,015 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c126b1c0300e95aceccfe332563e63fc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. started... 2023-02-11 19:03:23,016 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 19:03:23,016 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:23,016 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7ea9b3a72b6b06849cb7fb1b8566b010 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:23,016 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 19:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:23,016 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. started... 2023-02-11 19:03:23,017 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. started... 2023-02-11 19:03:23,017 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d046f904075ae6356fed6a66a08c65ef 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:23,017 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e7d22cb62b4f117de686c016c1009e59 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:23,018 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 19:03:23,020 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:23,020 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:23,020 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. started... 2023-02-11 19:03:23,021 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4ec29956dad592ee8609bdd43ea1772f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:23,024 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:23,025 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. started... 2023-02-11 19:03:23,027 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 35c49d2dfa905e03084d83b93e20035d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 19:03:23,083 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f1/74158b14dfa940f6a7d80e813a338884 2023-02-11 19:03:23,105 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f1/716c6be16b8c4843bfe0cc2afbc394e9 2023-02-11 19:03:23,105 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f1/e092f73301b845aa90a06fb2637e5adf 2023-02-11 19:03:23,105 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f1/3c092dff48f84e9ca32c354f6208deb0 2023-02-11 19:03:23,111 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f1/1f9bf177589045188d63ddaae4cbd3c7 2023-02-11 19:03:23,113 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f1/4772fe0d3f094a75a6ecf2d59e0c4153 2023-02-11 19:03:23,160 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f2/5e23742dbbce454784f2a77176994be1 2023-02-11 19:03:23,168 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f1/74158b14dfa940f6a7d80e813a338884 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/74158b14dfa940f6a7d80e813a338884 2023-02-11 19:03:23,175 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/74158b14dfa940f6a7d80e813a338884, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,177 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/.tmp/f2/5e23742dbbce454784f2a77176994be1 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/5e23742dbbce454784f2a77176994be1 2023-02-11 19:03:23,182 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f2/fdaf3f1272c74fd1913087f4fbfb7b89 2023-02-11 19:03:23,183 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f2/e6a1dbc69c974f8687e65c2fa5f031ab 2023-02-11 19:03:23,186 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f2/6ad8f8ba06a74543979ec91268f1e72d 2023-02-11 19:03:23,188 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f2/32f941586a4647faaabf9edff76ea041 2023-02-11 19:03:23,188 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f2/e67df9c486f14145af446496d7e8ec07 2023-02-11 19:03:23,189 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/5e23742dbbce454784f2a77176994be1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,190 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7ea9b3a72b6b06849cb7fb1b8566b010 in 174ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,190 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7ea9b3a72b6b06849cb7fb1b8566b010: 2023-02-11 19:03:23,190 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:23,190 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:23,190 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 19:03:23,190 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. started... 2023-02-11 19:03:23,191 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 576999b94045f2277f1a4af5553fcbd7 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 19:03:23,195 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f1/4772fe0d3f094a75a6ecf2d59e0c4153 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/4772fe0d3f094a75a6ecf2d59e0c4153 2023-02-11 19:03:23,196 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f1/716c6be16b8c4843bfe0cc2afbc394e9 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/716c6be16b8c4843bfe0cc2afbc394e9 2023-02-11 19:03:23,199 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f1/e092f73301b845aa90a06fb2637e5adf as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/e092f73301b845aa90a06fb2637e5adf 2023-02-11 19:03:23,200 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f1/1f9bf177589045188d63ddaae4cbd3c7 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/1f9bf177589045188d63ddaae4cbd3c7 2023-02-11 19:03:23,200 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f1/3c092dff48f84e9ca32c354f6208deb0 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/3c092dff48f84e9ca32c354f6208deb0 2023-02-11 19:03:23,206 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/716c6be16b8c4843bfe0cc2afbc394e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,208 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/4772fe0d3f094a75a6ecf2d59e0c4153, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:23,210 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/.tmp/f2/fdaf3f1272c74fd1913087f4fbfb7b89 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/fdaf3f1272c74fd1913087f4fbfb7b89 2023-02-11 19:03:23,211 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/.tmp/f2/e6a1dbc69c974f8687e65c2fa5f031ab as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/e6a1dbc69c974f8687e65c2fa5f031ab 2023-02-11 19:03:23,211 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/1f9bf177589045188d63ddaae4cbd3c7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,213 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/.tmp/f2/32f941586a4647faaabf9edff76ea041 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/32f941586a4647faaabf9edff76ea041 2023-02-11 19:03:23,222 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/e092f73301b845aa90a06fb2637e5adf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,224 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/3c092dff48f84e9ca32c354f6208deb0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,225 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/fdaf3f1272c74fd1913087f4fbfb7b89, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:23,227 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 35c49d2dfa905e03084d83b93e20035d in 202ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,227 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 35c49d2dfa905e03084d83b93e20035d: 2023-02-11 19:03:23,227 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:23,227 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 19:03:23,228 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/.tmp/f2/6ad8f8ba06a74543979ec91268f1e72d as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/6ad8f8ba06a74543979ec91268f1e72d 2023-02-11 19:03:23,229 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/32f941586a4647faaabf9edff76ea041, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,230 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d046f904075ae6356fed6a66a08c65ef in 213ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,231 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d046f904075ae6356fed6a66a08c65ef: 2023-02-11 19:03:23,231 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 19:03:23,231 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/e6a1dbc69c974f8687e65c2fa5f031ab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,232 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e7d22cb62b4f117de686c016c1009e59 in 215ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,232 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e7d22cb62b4f117de686c016c1009e59: 2023-02-11 19:03:23,232 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:23,236 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 19:03:23,236 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. started... 2023-02-11 19:03:23,237 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fc84fe42b2a24d860ba23bb2a186feb9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:23,237 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/.tmp/f2/e67df9c486f14145af446496d7e8ec07 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/e67df9c486f14145af446496d7e8ec07 2023-02-11 19:03:23,242 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f1/c42c5122873a4091bd42e45293f2146f 2023-02-11 19:03:23,247 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/e67df9c486f14145af446496d7e8ec07, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,248 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/6ad8f8ba06a74543979ec91268f1e72d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,248 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4ec29956dad592ee8609bdd43ea1772f in 228ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,248 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4ec29956dad592ee8609bdd43ea1772f: 2023-02-11 19:03:23,248 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:23,248 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:23,248 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 19:03:23,248 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. started... 2023-02-11 19:03:23,249 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 44ab9974e56c847afc9182f62f5816e5: 2023-02-11 19:03:23,249 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 19:03:23,249 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c126b1c0300e95aceccfe332563e63fc in 234ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,249 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c126b1c0300e95aceccfe332563e63fc: 2023-02-11 19:03:23,249 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 19:03:23,256 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f1/44f3dc4a159141838ce0f227b5b88736 2023-02-11 19:03:23,276 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f2/b88af50ea0144814b1583701023f1599 2023-02-11 19:03:23,283 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f1/c42c5122873a4091bd42e45293f2146f as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/c42c5122873a4091bd42e45293f2146f 2023-02-11 19:03:23,287 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f2/d981e6e4f4f24779ae68655f7b317161 2023-02-11 19:03:23,289 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/c42c5122873a4091bd42e45293f2146f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:23,290 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/.tmp/f2/b88af50ea0144814b1583701023f1599 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/b88af50ea0144814b1583701023f1599 2023-02-11 19:03:23,294 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f1/44f3dc4a159141838ce0f227b5b88736 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/44f3dc4a159141838ce0f227b5b88736 2023-02-11 19:03:23,297 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/b88af50ea0144814b1583701023f1599, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:23,300 INFO [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 576999b94045f2277f1a4af5553fcbd7 in 109ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,300 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 576999b94045f2277f1a4af5553fcbd7: 2023-02-11 19:03:23,301 DEBUG [rs(jenkins-hbase4.apache.org,45665,1676142194807)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:23,301 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 19:03:23,301 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 19:03:23,301 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,301 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 19:03:23,301 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45665,1676142194807' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 19:03:23,303 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,303 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:23,304 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/44f3dc4a159141838ce0f227b5b88736, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:23,304 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,304 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:23,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:23,305 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/.tmp/f2/d981e6e4f4f24779ae68655f7b317161 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/d981e6e4f4f24779ae68655f7b317161 2023-02-11 19:03:23,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:23,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45665,1676142194807' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 19:03:23,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71dc23cc[Count = 1] remaining members to acquire global barrier 2023-02-11 19:03:23,315 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/d981e6e4f4f24779ae68655f7b317161, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:23,316 INFO [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fc84fe42b2a24d860ba23bb2a186feb9 in 80ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:23,316 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fc84fe42b2a24d860ba23bb2a186feb9: 2023-02-11 19:03:23,316 DEBUG [rs(jenkins-hbase4.apache.org,46149,1676142194856)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 19:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 19:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 19:03:23,316 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46149,1676142194856' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 19:03:23,320 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,320 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:23,321 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,321 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46149,1676142194856' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 19:03:23,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71dc23cc[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:23,323 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 19:03:23,323 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,325 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 19:03:23,325 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,325 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 19:03:23,325 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 19:03:23,326 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 19:03:23,325 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46149,1676142194856' in zk 2023-02-11 19:03:23,326 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45665,1676142194807' in zk 2023-02-11 19:03:23,326 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,326 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:23,328 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 19:03:23,328 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,328 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:23,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:23,328 DEBUG [member: 'jenkins-hbase4.apache.org,46149,1676142194856' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 19:03:23,329 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 19:03:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,45665,1676142194807' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 19:03:23,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46149,1676142194856': 2023-02-11 19:03:23,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46149,1676142194856' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-11 19:03:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:23,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45665,1676142194807': 2023-02-11 19:03:23,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45665,1676142194807' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 19:03:23,337 INFO [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 19:03:23,337 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:23,337 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:23,337 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 19:03:23,337 INFO [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:03:23,341 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:23,341 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:23,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:23,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,341 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:23,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:23,342 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:23,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:23,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,342 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:23,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,345 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,346 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,356 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,356 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:23,357 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:23,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:23,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:23,357 DEBUG [(jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:23,357 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:23,357 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:23,357 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-11 19:03:23,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:23,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:23,358 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:23,361 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:23,361 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:03:23,461 DEBUG [Listener at localhost/37527] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:03:23,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:03:23,567 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop-2669908472706450434.jar 2023-02-11 19:03:23,583 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676142200587 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:23,584 DEBUG [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce 2023-02-11 19:03:23,585 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:23,585 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:23,585 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:23,585 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:23,585 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(239): region to add: 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=1b17bd65213dcae81dbc9ac62b8fb31b as 1b17bd65213dcae81dbc9ac62b8fb31b in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=7ea9b3a72b6b06849cb7fb1b8566b010 as 7ea9b3a72b6b06849cb7fb1b8566b010 in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=35c49d2dfa905e03084d83b93e20035d as 35c49d2dfa905e03084d83b93e20035d in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=c126b1c0300e95aceccfe332563e63fc as c126b1c0300e95aceccfe332563e63fc in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=e7d22cb62b4f117de686c016c1009e59 as e7d22cb62b4f117de686c016c1009e59 in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=4ec29956dad592ee8609bdd43ea1772f as 4ec29956dad592ee8609bdd43ea1772f in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=d046f904075ae6356fed6a66a08c65ef as d046f904075ae6356fed6a66a08c65ef in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,586 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=fc84fe42b2a24d860ba23bb2a186feb9 as fc84fe42b2a24d860ba23bb2a186feb9 in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,587 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=44ab9974e56c847afc9182f62f5816e5 as 44ab9974e56c847afc9182f62f5816e5 in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,587 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(585): clone region=576999b94045f2277f1a4af5553fcbd7 as 576999b94045f2277f1a4af5553fcbd7 in snapshot testWithMapReduceMultiRegion 2023-02-11 19:03:23,590 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4ec29956dad592ee8609bdd43ea1772f, NAME => 'testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,591 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => c126b1c0300e95aceccfe332563e63fc, NAME => 'testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,592 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => e7d22cb62b4f117de686c016c1009e59, NAME => 'testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,592 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d046f904075ae6356fed6a66a08c65ef, NAME => 'testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,592 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => fc84fe42b2a24d860ba23bb2a186feb9, NAME => 'testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,592 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1b17bd65213dcae81dbc9ac62b8fb31b, NAME => 'testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,592 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 35c49d2dfa905e03084d83b93e20035d, NAME => 'testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,592 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7ea9b3a72b6b06849cb7fb1b8566b010, NAME => 'testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,628 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,628 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,629 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f547555246f429a96ae27109f27bede from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,629 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a66a7e8b010d4b3bb64331c491eb34be from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,630 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,630 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ccdcb53bc8749b9831a2b5c0f34b9b7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,640 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,640 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,640 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1b17bd65213dcae81dbc9ac62b8fb31b, disabling compactions & flushes 2023-02-11 19:03:23,641 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 36a62f990d3442f69e758a33d66b849f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,641 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:23,641 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:23,641 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. after waiting 0 ms 2023-02-11 19:03:23,641 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:23,641 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:23,641 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1b17bd65213dcae81dbc9ac62b8fb31b: Waiting for close lock at 1676142203640Disabling compacts and flushes for region at 1676142203640Disabling writes for close at 1676142203641 (+1 ms)Writing region close event to WAL at 1676142203641Closed at 1676142203641 2023-02-11 19:03:23,642 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 44ab9974e56c847afc9182f62f5816e5, NAME => 'testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,645 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 513f365d6a7a4f609460f7cc871fe413 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,645 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e3d2aba2007f4f4e8631685ca141c487 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,691 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,691 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f28f234237d048298683d692af7bdcac from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,693 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cff78e9b0ccb44b6b4b06c5bb1d3bd61 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,695 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7ea9b3a72b6b06849cb7fb1b8566b010, disabling compactions & flushes 2023-02-11 19:03:23,695 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:23,695 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4ec29956dad592ee8609bdd43ea1772f, disabling compactions & flushes 2023-02-11 19:03:23,695 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:23,695 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. after waiting 0 ms 2023-02-11 19:03:23,695 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:23,695 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:23,695 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7ea9b3a72b6b06849cb7fb1b8566b010: Waiting for close lock at 1676142203695Disabling compacts and flushes for region at 1676142203695Disabling writes for close at 1676142203695Writing region close event to WAL at 1676142203695Closed at 1676142203695 2023-02-11 19:03:23,696 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 576999b94045f2277f1a4af5553fcbd7, NAME => 'testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:23,695 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:23,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:23,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. after waiting 0 ms 2023-02-11 19:03:23,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:23,696 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:23,696 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4ec29956dad592ee8609bdd43ea1772f: Waiting for close lock at 1676142203695Disabling compacts and flushes for region at 1676142203695Disabling writes for close at 1676142203696 (+1 ms)Writing region close event to WAL at 1676142203696Closed at 1676142203696 2023-02-11 19:03:23,697 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 676c8ed7236b49cf9aece7c831e919e9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,701 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,701 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 690fb0b127514915b5959e14c44114a0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,708 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fd00a0d79b7d40f1a02062d5c9c083fa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,708 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f5cf82d474544c029ecd03fb02b111ad from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,708 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 35c49d2dfa905e03084d83b93e20035d, disabling compactions & flushes 2023-02-11 19:03:23,708 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:23,708 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:23,708 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. after waiting 0 ms 2023-02-11 19:03:23,708 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:23,708 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:23,708 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 35c49d2dfa905e03084d83b93e20035d: Waiting for close lock at 1676142203708Disabling compacts and flushes for region at 1676142203708Disabling writes for close at 1676142203708Writing region close event to WAL at 1676142203708Closed at 1676142203708 2023-02-11 19:03:23,716 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,716 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 44ab9974e56c847afc9182f62f5816e5, disabling compactions & flushes 2023-02-11 19:03:23,717 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d046f904075ae6356fed6a66a08c65ef, disabling compactions & flushes 2023-02-11 19:03:23,717 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing c126b1c0300e95aceccfe332563e63fc, disabling compactions & flushes 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. after waiting 0 ms 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. after waiting 0 ms 2023-02-11 19:03:23,717 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. after waiting 0 ms 2023-02-11 19:03:23,718 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:23,718 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:23,718 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for c126b1c0300e95aceccfe332563e63fc: Waiting for close lock at 1676142203717Disabling compacts and flushes for region at 1676142203717Disabling writes for close at 1676142203718 (+1 ms)Writing region close event to WAL at 1676142203718Closed at 1676142203718 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:23,717 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:23,718 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:23,718 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:23,718 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d046f904075ae6356fed6a66a08c65ef: Waiting for close lock at 1676142203717Disabling compacts and flushes for region at 1676142203717Disabling writes for close at 1676142203717Writing region close event to WAL at 1676142203718 (+1 ms)Closed at 1676142203718 2023-02-11 19:03:23,718 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 44ab9974e56c847afc9182f62f5816e5: Waiting for close lock at 1676142203716Disabling compacts and flushes for region at 1676142203716Disabling writes for close at 1676142203717 (+1 ms)Writing region close event to WAL at 1676142203718 (+1 ms)Closed at 1676142203718 2023-02-11 19:03:23,718 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing e7d22cb62b4f117de686c016c1009e59, disabling compactions & flushes 2023-02-11 19:03:23,718 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:23,718 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:23,719 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. after waiting 0 ms 2023-02-11 19:03:23,719 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:23,719 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:23,719 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for e7d22cb62b4f117de686c016c1009e59: Waiting for close lock at 1676142203718Disabling compacts and flushes for region at 1676142203718Disabling writes for close at 1676142203719 (+1 ms)Writing region close event to WAL at 1676142203719Closed at 1676142203719 2023-02-11 19:03:23,724 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:23,724 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1098a10bf3a64035b086157c5e0a55e7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,726 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fe1e8d26916f4678a00d361ca5c8a470 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:23,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 576999b94045f2277f1a4af5553fcbd7, disabling compactions & flushes 2023-02-11 19:03:23,729 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:23,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:23,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. after waiting 0 ms 2023-02-11 19:03:23,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:23,729 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:23,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 576999b94045f2277f1a4af5553fcbd7: Waiting for close lock at 1676142203729Disabling compacts and flushes for region at 1676142203729Disabling writes for close at 1676142203729Writing region close event to WAL at 1676142203729Closed at 1676142203729 2023-02-11 19:03:23,780 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:23,780 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-11 19:03:24,100 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:24,100 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 627821d3aa054294afe734afb55a38f2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:24,103 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 86ff2fc2ff4349dca432ee34e8613d50 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 19:03:24,106 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing fc84fe42b2a24d860ba23bb2a186feb9, disabling compactions & flushes 2023-02-11 19:03:24,106 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:24,106 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:24,106 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. after waiting 0 ms 2023-02-11 19:03:24,106 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:24,106 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:24,106 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for fc84fe42b2a24d860ba23bb2a186feb9: Waiting for close lock at 1676142204106Disabling compacts and flushes for region at 1676142204106Disabling writes for close at 1676142204106Writing region close event to WAL at 1676142204106Closed at 1676142204106 2023-02-11 19:03:24,107 INFO [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676142200587 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:24,107 DEBUG [Listener at localhost/37527] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:24,107 DEBUG [Listener at localhost/37527] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9 2023-02-11 19:03:24,108 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-data/ 2023-02-11 19:03:24,109 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----default/ 2023-02-11 19:03:24,109 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 19:03:24,110 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------1b17bd65213dcae81dbc9ac62b8fb31b/ 2023-02-11 19:03:24,110 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,110 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------35c49d2dfa905e03084d83b93e20035d/ 2023-02-11 19:03:24,111 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,111 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,111 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=35c49d2dfa905e03084d83b93e20035d-2ccdcb53bc8749b9831a2b5c0f34b9b7 2023-02-11 19:03:24,111 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,112 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=35c49d2dfa905e03084d83b93e20035d-cff78e9b0ccb44b6b4b06c5bb1d3bd61 2023-02-11 19:03:24,112 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------44ab9974e56c847afc9182f62f5816e5/ 2023-02-11 19:03:24,112 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,112 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------4ec29956dad592ee8609bdd43ea1772f/ 2023-02-11 19:03:24,113 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,113 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,113 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=4ec29956dad592ee8609bdd43ea1772f-a66a7e8b010d4b3bb64331c491eb34be 2023-02-11 19:03:24,114 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,114 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=4ec29956dad592ee8609bdd43ea1772f-513f365d6a7a4f609460f7cc871fe413 2023-02-11 19:03:24,114 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------576999b94045f2277f1a4af5553fcbd7/ 2023-02-11 19:03:24,114 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,115 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,115 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=576999b94045f2277f1a4af5553fcbd7-1098a10bf3a64035b086157c5e0a55e7 2023-02-11 19:03:24,115 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,115 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=576999b94045f2277f1a4af5553fcbd7-fe1e8d26916f4678a00d361ca5c8a470 2023-02-11 19:03:24,115 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------7ea9b3a72b6b06849cb7fb1b8566b010/ 2023-02-11 19:03:24,116 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,116 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,116 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=7ea9b3a72b6b06849cb7fb1b8566b010-2f547555246f429a96ae27109f27bede 2023-02-11 19:03:24,116 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,117 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=7ea9b3a72b6b06849cb7fb1b8566b010-e3d2aba2007f4f4e8631685ca141c487 2023-02-11 19:03:24,117 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------c126b1c0300e95aceccfe332563e63fc/ 2023-02-11 19:03:24,117 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,117 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,118 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=c126b1c0300e95aceccfe332563e63fc-690fb0b127514915b5959e14c44114a0 2023-02-11 19:03:24,118 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,118 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=c126b1c0300e95aceccfe332563e63fc-f5cf82d474544c029ecd03fb02b111ad 2023-02-11 19:03:24,118 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------d046f904075ae6356fed6a66a08c65ef/ 2023-02-11 19:03:24,119 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,119 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,120 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=d046f904075ae6356fed6a66a08c65ef-36a62f990d3442f69e758a33d66b849f 2023-02-11 19:03:24,120 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,120 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=d046f904075ae6356fed6a66a08c65ef-676c8ed7236b49cf9aece7c831e919e9 2023-02-11 19:03:24,120 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------e7d22cb62b4f117de686c016c1009e59/ 2023-02-11 19:03:24,121 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,121 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,122 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=e7d22cb62b4f117de686c016c1009e59-f28f234237d048298683d692af7bdcac 2023-02-11 19:03:24,122 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,122 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=e7d22cb62b4f117de686c016c1009e59-fd00a0d79b7d40f1a02062d5c9c083fa 2023-02-11 19:03:24,123 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |----------fc84fe42b2a24d860ba23bb2a186feb9/ 2023-02-11 19:03:24,123 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:24,123 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:24,124 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=fc84fe42b2a24d860ba23bb2a186feb9-627821d3aa054294afe734afb55a38f2 2023-02-11 19:03:24,124 DEBUG [Listener at localhost/37527] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:24,124 DEBUG [Listener at localhost/37527] util.CommonFSUtils(702): |----------------testWithMapReduce=fc84fe42b2a24d860ba23bb2a186feb9-86ff2fc2ff4349dca432ee34e8613d50 2023-02-11 19:03:24,133 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:24,134 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:24,134 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:24,135 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,133 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop-1530893083099442402.jar 2023-02-11 19:03:25,134 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,134 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,208 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop-4077032714229108903.jar 2023-02-11 19:03:25,209 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,209 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,209 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,210 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,210 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,211 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,211 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 19:03:25,212 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 19:03:25,212 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 19:03:25,213 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 19:03:25,213 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 19:03:25,214 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 19:03:25,214 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 19:03:25,214 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 19:03:25,215 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 19:03:25,215 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 19:03:25,221 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:25,222 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:03:25,222 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:03:25,223 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:03:25,223 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 19:03:25,306 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop-4135209010425950012.jar 2023-02-11 19:03:25,307 DEBUG [Listener at localhost/37527] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 19:03:25,362 WARN [Listener at localhost/37527] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 19:03:25,375 WARN [Listener at localhost/37527] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-11 19:03:25,388 INFO [Listener at localhost/37527] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 19:03:25,822 WARN [Listener at localhost/37527] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/mapreduce.cluster.local.dir/1676142205709/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 19:03:25,822 WARN [Listener at localhost/37527] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/mapreduce.cluster.local.dir/1676142205709/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 19:03:25,983 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:25,983 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:25,985 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:25,988 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:25,990 DEBUG [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f1 2023-02-11 19:03:25,991 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b17bd65213dcae81dbc9ac62b8fb31b columnFamilyName f1 2023-02-11 19:03:25,991 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(310): Store=1b17bd65213dcae81dbc9ac62b8fb31b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:25,992 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:25,994 DEBUG [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f2 2023-02-11 19:03:25,994 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b17bd65213dcae81dbc9ac62b8fb31b columnFamilyName f2 2023-02-11 19:03:25,995 INFO [StoreOpener-1b17bd65213dcae81dbc9ac62b8fb31b-1] regionserver.HStore(310): Store=1b17bd65213dcae81dbc9ac62b8fb31b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:25,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:25,995 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1b17bd65213dcae81dbc9ac62b8fb31b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62555320, jitterRate=-0.06785309314727783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:25,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1b17bd65213dcae81dbc9ac62b8fb31b: Writing region info on filesystem at 1676142205986Initializing all the Stores at 1676142205987 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142205987Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142205987Region opened successfully at 1676142205995 (+8 ms) 2023-02-11 19:03:26,038 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1b17bd65213dcae81dbc9ac62b8fb31b, disabling compactions & flushes 2023-02-11 19:03:26,038 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:26,038 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:26,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. after waiting 0 ms 2023-02-11 19:03:26,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:26,039 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:26,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1b17bd65213dcae81dbc9ac62b8fb31b: Waiting for close lock at 1676142206038Disabling compacts and flushes for region at 1676142206038Disabling writes for close at 1676142206039 (+1 ms)Writing region close event to WAL at 1676142206039Closed at 1676142206039 2023-02-11 19:03:26,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,057 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,060 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,063 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:26,064 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1 2023-02-11 19:03:26,064 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 576999b94045f2277f1a4af5553fcbd7 columnFamilyName f1 2023-02-11 19:03:26,073 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/testWithMapReduce=576999b94045f2277f1a4af5553fcbd7-1098a10bf3a64035b086157c5e0a55e7 2023-02-11 19:03:26,073 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(310): Store=576999b94045f2277f1a4af5553fcbd7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,074 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:26,081 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2 2023-02-11 19:03:26,081 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 576999b94045f2277f1a4af5553fcbd7 columnFamilyName f2 2023-02-11 19:03:26,087 DEBUG [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/testWithMapReduce=576999b94045f2277f1a4af5553fcbd7-fe1e8d26916f4678a00d361ca5c8a470 2023-02-11 19:03:26,087 INFO [StoreOpener-576999b94045f2277f1a4af5553fcbd7-1] regionserver.HStore(310): Store=576999b94045f2277f1a4af5553fcbd7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,088 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,088 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 576999b94045f2277f1a4af5553fcbd7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68350994, jitterRate=0.01850917935371399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,088 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 576999b94045f2277f1a4af5553fcbd7: Writing region info on filesystem at 1676142206061Initializing all the Stores at 1676142206062 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206062Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206062Region opened successfully at 1676142206088 (+26 ms) 2023-02-11 19:03:26,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 576999b94045f2277f1a4af5553fcbd7, disabling compactions & flushes 2023-02-11 19:03:26,246 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:26,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:26,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. after waiting 0 ms 2023-02-11 19:03:26,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:26,253 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:26,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 576999b94045f2277f1a4af5553fcbd7: Waiting for close lock at 1676142206246Disabling compacts and flushes for region at 1676142206246Disabling writes for close at 1676142206246Writing region close event to WAL at 1676142206253 (+7 ms)Closed at 1676142206253 2023-02-11 19:03:26,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,260 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,265 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,269 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:26,270 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1 2023-02-11 19:03:26,270 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ea9b3a72b6b06849cb7fb1b8566b010 columnFamilyName f1 2023-02-11 19:03:26,279 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/testWithMapReduce=7ea9b3a72b6b06849cb7fb1b8566b010-2f547555246f429a96ae27109f27bede 2023-02-11 19:03:26,279 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(310): Store=7ea9b3a72b6b06849cb7fb1b8566b010/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,279 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:26,281 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2 2023-02-11 19:03:26,282 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ea9b3a72b6b06849cb7fb1b8566b010 columnFamilyName f2 2023-02-11 19:03:26,292 DEBUG [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/testWithMapReduce=7ea9b3a72b6b06849cb7fb1b8566b010-e3d2aba2007f4f4e8631685ca141c487 2023-02-11 19:03:26,293 INFO [StoreOpener-7ea9b3a72b6b06849cb7fb1b8566b010-1] regionserver.HStore(310): Store=7ea9b3a72b6b06849cb7fb1b8566b010/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,293 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7ea9b3a72b6b06849cb7fb1b8566b010; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73252579, jitterRate=0.09154848754405975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7ea9b3a72b6b06849cb7fb1b8566b010: Writing region info on filesystem at 1676142206265Initializing all the Stores at 1676142206267 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206267Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206268 (+1 ms)Region opened successfully at 1676142206293 (+25 ms) 2023-02-11 19:03:26,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7ea9b3a72b6b06849cb7fb1b8566b010, disabling compactions & flushes 2023-02-11 19:03:26,375 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:26,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:26,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. after waiting 0 ms 2023-02-11 19:03:26,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:26,379 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:26,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7ea9b3a72b6b06849cb7fb1b8566b010: Waiting for close lock at 1676142206375Disabling compacts and flushes for region at 1676142206375Disabling writes for close at 1676142206375Writing region close event to WAL at 1676142206379 (+4 ms)Closed at 1676142206379 2023-02-11 19:03:26,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,384 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,386 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,389 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:26,390 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1 2023-02-11 19:03:26,391 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35c49d2dfa905e03084d83b93e20035d columnFamilyName f1 2023-02-11 19:03:26,401 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/testWithMapReduce=35c49d2dfa905e03084d83b93e20035d-2ccdcb53bc8749b9831a2b5c0f34b9b7 2023-02-11 19:03:26,401 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(310): Store=35c49d2dfa905e03084d83b93e20035d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,401 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:26,408 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2 2023-02-11 19:03:26,409 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35c49d2dfa905e03084d83b93e20035d columnFamilyName f2 2023-02-11 19:03:26,416 DEBUG [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/testWithMapReduce=35c49d2dfa905e03084d83b93e20035d-cff78e9b0ccb44b6b4b06c5bb1d3bd61 2023-02-11 19:03:26,416 INFO [StoreOpener-35c49d2dfa905e03084d83b93e20035d-1] regionserver.HStore(310): Store=35c49d2dfa905e03084d83b93e20035d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,417 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 35c49d2dfa905e03084d83b93e20035d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74174044, jitterRate=0.10527938604354858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 35c49d2dfa905e03084d83b93e20035d: Writing region info on filesystem at 1676142206386Initializing all the Stores at 1676142206388 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206388Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206388Region opened successfully at 1676142206417 (+29 ms) 2023-02-11 19:03:26,478 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 35c49d2dfa905e03084d83b93e20035d, disabling compactions & flushes 2023-02-11 19:03:26,478 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:26,478 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:26,478 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. after waiting 0 ms 2023-02-11 19:03:26,478 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:26,487 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:26,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 35c49d2dfa905e03084d83b93e20035d: Waiting for close lock at 1676142206478Disabling compacts and flushes for region at 1676142206478Disabling writes for close at 1676142206478Writing region close event to WAL at 1676142206487 (+9 ms)Closed at 1676142206487 2023-02-11 19:03:26,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,494 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,502 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,504 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:26,506 DEBUG [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f1 2023-02-11 19:03:26,507 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44ab9974e56c847afc9182f62f5816e5 columnFamilyName f1 2023-02-11 19:03:26,507 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(310): Store=44ab9974e56c847afc9182f62f5816e5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,507 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:26,509 DEBUG [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f2 2023-02-11 19:03:26,509 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44ab9974e56c847afc9182f62f5816e5 columnFamilyName f2 2023-02-11 19:03:26,510 INFO [StoreOpener-44ab9974e56c847afc9182f62f5816e5-1] regionserver.HStore(310): Store=44ab9974e56c847afc9182f62f5816e5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,510 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 44ab9974e56c847afc9182f62f5816e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71152266, jitterRate=0.060251384973526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 44ab9974e56c847afc9182f62f5816e5: Writing region info on filesystem at 1676142206502Initializing all the Stores at 1676142206503 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206503Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206504 (+1 ms)Region opened successfully at 1676142206510 (+6 ms) 2023-02-11 19:03:26,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 44ab9974e56c847afc9182f62f5816e5, disabling compactions & flushes 2023-02-11 19:03:26,529 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:26,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:26,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. after waiting 0 ms 2023-02-11 19:03:26,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:26,530 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:26,530 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 44ab9974e56c847afc9182f62f5816e5: Waiting for close lock at 1676142206529Disabling compacts and flushes for region at 1676142206529Disabling writes for close at 1676142206529Writing region close event to WAL at 1676142206530 (+1 ms)Closed at 1676142206530 2023-02-11 19:03:26,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,535 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,540 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,544 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:26,546 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1 2023-02-11 19:03:26,546 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c126b1c0300e95aceccfe332563e63fc columnFamilyName f1 2023-02-11 19:03:26,553 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/testWithMapReduce=c126b1c0300e95aceccfe332563e63fc-690fb0b127514915b5959e14c44114a0 2023-02-11 19:03:26,553 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(310): Store=c126b1c0300e95aceccfe332563e63fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,553 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:26,554 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2 2023-02-11 19:03:26,555 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c126b1c0300e95aceccfe332563e63fc columnFamilyName f2 2023-02-11 19:03:26,561 DEBUG [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/testWithMapReduce=c126b1c0300e95aceccfe332563e63fc-f5cf82d474544c029ecd03fb02b111ad 2023-02-11 19:03:26,561 INFO [StoreOpener-c126b1c0300e95aceccfe332563e63fc-1] regionserver.HStore(310): Store=c126b1c0300e95aceccfe332563e63fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,562 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c126b1c0300e95aceccfe332563e63fc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71867313, jitterRate=0.07090641558170319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c126b1c0300e95aceccfe332563e63fc: Writing region info on filesystem at 1676142206540Initializing all the Stores at 1676142206541 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206541Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206544 (+3 ms)Region opened successfully at 1676142206562 (+18 ms) 2023-02-11 19:03:26,609 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c126b1c0300e95aceccfe332563e63fc, disabling compactions & flushes 2023-02-11 19:03:26,610 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:26,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:26,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. after waiting 0 ms 2023-02-11 19:03:26,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:26,621 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:26,621 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c126b1c0300e95aceccfe332563e63fc: Waiting for close lock at 1676142206609Disabling compacts and flushes for region at 1676142206609Disabling writes for close at 1676142206610 (+1 ms)Writing region close event to WAL at 1676142206621 (+11 ms)Closed at 1676142206621 2023-02-11 19:03:26,626 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,627 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,629 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,635 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:26,636 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1 2023-02-11 19:03:26,637 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ec29956dad592ee8609bdd43ea1772f columnFamilyName f1 2023-02-11 19:03:26,645 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/testWithMapReduce=4ec29956dad592ee8609bdd43ea1772f-a66a7e8b010d4b3bb64331c491eb34be 2023-02-11 19:03:26,646 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(310): Store=4ec29956dad592ee8609bdd43ea1772f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,646 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:26,647 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2 2023-02-11 19:03:26,647 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ec29956dad592ee8609bdd43ea1772f columnFamilyName f2 2023-02-11 19:03:26,655 DEBUG [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/testWithMapReduce=4ec29956dad592ee8609bdd43ea1772f-513f365d6a7a4f609460f7cc871fe413 2023-02-11 19:03:26,655 INFO [StoreOpener-4ec29956dad592ee8609bdd43ea1772f-1] regionserver.HStore(310): Store=4ec29956dad592ee8609bdd43ea1772f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,655 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4ec29956dad592ee8609bdd43ea1772f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59828191, jitterRate=-0.1084904819726944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4ec29956dad592ee8609bdd43ea1772f: Writing region info on filesystem at 1676142206629Initializing all the Stores at 1676142206630 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206630Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206635 (+5 ms)Region opened successfully at 1676142206655 (+20 ms) 2023-02-11 19:03:26,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4ec29956dad592ee8609bdd43ea1772f, disabling compactions & flushes 2023-02-11 19:03:26,709 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:26,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:26,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. after waiting 0 ms 2023-02-11 19:03:26,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:26,713 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:26,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4ec29956dad592ee8609bdd43ea1772f: Waiting for close lock at 1676142206709Disabling compacts and flushes for region at 1676142206709Disabling writes for close at 1676142206709Writing region close event to WAL at 1676142206713 (+4 ms)Closed at 1676142206713 2023-02-11 19:03:26,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,716 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,724 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,726 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:26,729 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1 2023-02-11 19:03:26,729 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d046f904075ae6356fed6a66a08c65ef columnFamilyName f1 2023-02-11 19:03:26,736 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/testWithMapReduce=d046f904075ae6356fed6a66a08c65ef-36a62f990d3442f69e758a33d66b849f 2023-02-11 19:03:26,737 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(310): Store=d046f904075ae6356fed6a66a08c65ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,737 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:26,738 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2 2023-02-11 19:03:26,738 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d046f904075ae6356fed6a66a08c65ef columnFamilyName f2 2023-02-11 19:03:26,744 DEBUG [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/testWithMapReduce=d046f904075ae6356fed6a66a08c65ef-676c8ed7236b49cf9aece7c831e919e9 2023-02-11 19:03:26,744 INFO [StoreOpener-d046f904075ae6356fed6a66a08c65ef-1] regionserver.HStore(310): Store=d046f904075ae6356fed6a66a08c65ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,744 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d046f904075ae6356fed6a66a08c65ef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65032110, jitterRate=-0.030946046113967896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d046f904075ae6356fed6a66a08c65ef: Writing region info on filesystem at 1676142206724Initializing all the Stores at 1676142206726 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206726Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206726Region opened successfully at 1676142206744 (+18 ms) 2023-02-11 19:03:26,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d046f904075ae6356fed6a66a08c65ef, disabling compactions & flushes 2023-02-11 19:03:26,777 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:26,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:26,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. after waiting 0 ms 2023-02-11 19:03:26,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:26,779 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:26,779 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d046f904075ae6356fed6a66a08c65ef: Waiting for close lock at 1676142206776Disabling compacts and flushes for region at 1676142206776Disabling writes for close at 1676142206777 (+1 ms)Writing region close event to WAL at 1676142206779 (+2 ms)Closed at 1676142206779 2023-02-11 19:03:26,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,784 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,787 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,789 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:26,790 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1 2023-02-11 19:03:26,790 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc84fe42b2a24d860ba23bb2a186feb9 columnFamilyName f1 2023-02-11 19:03:26,798 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/testWithMapReduce=fc84fe42b2a24d860ba23bb2a186feb9-627821d3aa054294afe734afb55a38f2 2023-02-11 19:03:26,798 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(310): Store=fc84fe42b2a24d860ba23bb2a186feb9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,798 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:26,799 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2 2023-02-11 19:03:26,799 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc84fe42b2a24d860ba23bb2a186feb9 columnFamilyName f2 2023-02-11 19:03:26,808 DEBUG [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/testWithMapReduce=fc84fe42b2a24d860ba23bb2a186feb9-86ff2fc2ff4349dca432ee34e8613d50 2023-02-11 19:03:26,809 INFO [StoreOpener-fc84fe42b2a24d860ba23bb2a186feb9-1] regionserver.HStore(310): Store=fc84fe42b2a24d860ba23bb2a186feb9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,809 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,809 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fc84fe42b2a24d860ba23bb2a186feb9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73358280, jitterRate=0.09312355518341064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,809 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fc84fe42b2a24d860ba23bb2a186feb9: Writing region info on filesystem at 1676142206787Initializing all the Stores at 1676142206788 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206788Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206788Region opened successfully at 1676142206809 (+21 ms) 2023-02-11 19:03:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fc84fe42b2a24d860ba23bb2a186feb9, disabling compactions & flushes 2023-02-11 19:03:26,838 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. after waiting 0 ms 2023-02-11 19:03:26,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:26,841 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:26,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fc84fe42b2a24d860ba23bb2a186feb9: Waiting for close lock at 1676142206838Disabling compacts and flushes for region at 1676142206838Disabling writes for close at 1676142206838Writing region close event to WAL at 1676142206841 (+3 ms)Closed at 1676142206841 2023-02-11 19:03:26,845 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:26,845 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:26,850 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:26,852 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:26,853 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1 2023-02-11 19:03:26,853 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7d22cb62b4f117de686c016c1009e59 columnFamilyName f1 2023-02-11 19:03:26,860 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/testWithMapReduce=e7d22cb62b4f117de686c016c1009e59-f28f234237d048298683d692af7bdcac 2023-02-11 19:03:26,861 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(310): Store=e7d22cb62b4f117de686c016c1009e59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,861 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:26,862 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2 2023-02-11 19:03:26,862 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7d22cb62b4f117de686c016c1009e59 columnFamilyName f2 2023-02-11 19:03:26,868 DEBUG [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(539): loaded hdfs://localhost:44011/user/jenkins/test-data/8bd6142d-47dc-6352-4ae4-557daa230638/testWithMapReduceMultiRegion/1f2332d8-a635-459d-972c-3aec005dada9/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/testWithMapReduce=e7d22cb62b4f117de686c016c1009e59-fd00a0d79b7d40f1a02062d5c9c083fa 2023-02-11 19:03:26,868 INFO [StoreOpener-e7d22cb62b4f117de686c016c1009e59-1] regionserver.HStore(310): Store=e7d22cb62b4f117de686c016c1009e59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:26,868 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:26,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e7d22cb62b4f117de686c016c1009e59; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73449310, jitterRate=0.0944800078868866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:26,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e7d22cb62b4f117de686c016c1009e59: Writing region info on filesystem at 1676142206850Initializing all the Stores at 1676142206851 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206851Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142206851Region opened successfully at 1676142206869 (+18 ms) 2023-02-11 19:03:26,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e7d22cb62b4f117de686c016c1009e59, disabling compactions & flushes 2023-02-11 19:03:26,902 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:26,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:26,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. after waiting 0 ms 2023-02-11 19:03:26,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:26,909 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:26,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e7d22cb62b4f117de686c016c1009e59: Waiting for close lock at 1676142206902Disabling compacts and flushes for region at 1676142206902Disabling writes for close at 1676142206902Writing region close event to WAL at 1676142206909 (+7 ms)Closed at 1676142206909 2023-02-11 19:03:27,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-11 19:03:27,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-11 19:03:27,909 INFO [Listener at localhost/37527] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 19:03:27,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 19:03:27,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-11 19:03:27,920 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142207920"}]},"ts":"1676142207920"} 2023-02-11 19:03:27,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:27,922 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-11 19:03:27,924 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-11 19:03:27,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, UNASSIGN}] 2023-02-11 19:03:27,931 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, UNASSIGN 2023-02-11 19:03:27,931 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, UNASSIGN 2023-02-11 19:03:27,931 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, UNASSIGN 2023-02-11 19:03:27,931 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, UNASSIGN 2023-02-11 19:03:27,932 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, UNASSIGN 2023-02-11 19:03:27,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d046f904075ae6356fed6a66a08c65ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:27,933 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4ec29956dad592ee8609bdd43ea1772f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:27,933 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=576999b94045f2277f1a4af5553fcbd7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:27,933 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207933"}]},"ts":"1676142207933"} 2023-02-11 19:03:27,934 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207933"}]},"ts":"1676142207933"} 2023-02-11 19:03:27,934 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=fc84fe42b2a24d860ba23bb2a186feb9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:27,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207934"}]},"ts":"1676142207934"} 2023-02-11 19:03:27,934 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=44ab9974e56c847afc9182f62f5816e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:27,934 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142207934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207934"}]},"ts":"1676142207934"} 2023-02-11 19:03:27,933 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207933"}]},"ts":"1676142207933"} 2023-02-11 19:03:27,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=41, state=RUNNABLE; CloseRegionProcedure d046f904075ae6356fed6a66a08c65ef, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:27,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=42, state=RUNNABLE; CloseRegionProcedure 576999b94045f2277f1a4af5553fcbd7, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:27,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure fc84fe42b2a24d860ba23bb2a186feb9, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:27,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 44ab9974e56c847afc9182f62f5816e5, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:27,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=40, state=RUNNABLE; CloseRegionProcedure 4ec29956dad592ee8609bdd43ea1772f, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:27,949 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, UNASSIGN 2023-02-11 19:03:27,949 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, UNASSIGN 2023-02-11 19:03:27,956 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e7d22cb62b4f117de686c016c1009e59, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:27,956 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7ea9b3a72b6b06849cb7fb1b8566b010, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:27,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207956"}]},"ts":"1676142207956"} 2023-02-11 19:03:27,956 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207956"}]},"ts":"1676142207956"} 2023-02-11 19:03:27,957 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, UNASSIGN 2023-02-11 19:03:27,957 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, UNASSIGN 2023-02-11 19:03:27,958 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, UNASSIGN 2023-02-11 19:03:27,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure e7d22cb62b4f117de686c016c1009e59, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:27,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c126b1c0300e95aceccfe332563e63fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:27,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=1b17bd65213dcae81dbc9ac62b8fb31b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:27,960 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207959"}]},"ts":"1676142207959"} 2023-02-11 19:03:27,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142207959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207959"}]},"ts":"1676142207959"} 2023-02-11 19:03:27,960 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=35c49d2dfa905e03084d83b93e20035d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:27,960 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142207960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142207960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142207960"}]},"ts":"1676142207960"} 2023-02-11 19:03:27,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 7ea9b3a72b6b06849cb7fb1b8566b010, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:27,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure c126b1c0300e95aceccfe332563e63fc, server=jenkins-hbase4.apache.org,46149,1676142194856}] 2023-02-11 19:03:27,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure 1b17bd65213dcae81dbc9ac62b8fb31b, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:27,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=35, state=RUNNABLE; CloseRegionProcedure 35c49d2dfa905e03084d83b93e20035d, server=jenkins-hbase4.apache.org,45665,1676142194807}] 2023-02-11 19:03:28,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:28,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:28,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d046f904075ae6356fed6a66a08c65ef, disabling compactions & flushes 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4ec29956dad592ee8609bdd43ea1772f, disabling compactions & flushes 2023-02-11 19:03:28,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:28,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. after waiting 0 ms 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. after waiting 0 ms 2023-02-11 19:03:28,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:28,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef. 2023-02-11 19:03:28,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f. 2023-02-11 19:03:28,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d046f904075ae6356fed6a66a08c65ef: Waiting for close lock at 1676142208101Running coprocessor pre-close hooks at 1676142208101Disabling compacts and flushes for region at 1676142208101Disabling writes for close at 1676142208101Writing region close event to WAL at 1676142208108 (+7 ms)Running coprocessor post-close hooks at 1676142208113 (+5 ms)Closed at 1676142208114 (+1 ms) 2023-02-11 19:03:28,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4ec29956dad592ee8609bdd43ea1772f: Waiting for close lock at 1676142208101Running coprocessor pre-close hooks at 1676142208101Disabling compacts and flushes for region at 1676142208101Disabling writes for close at 1676142208101Writing region close event to WAL at 1676142208108 (+7 ms)Running coprocessor post-close hooks at 1676142208113 (+5 ms)Closed at 1676142208114 (+1 ms) 2023-02-11 19:03:28,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:28,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:28,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7ea9b3a72b6b06849cb7fb1b8566b010, disabling compactions & flushes 2023-02-11 19:03:28,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:28,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:28,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. after waiting 0 ms 2023-02-11 19:03:28,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:28,116 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d046f904075ae6356fed6a66a08c65ef, regionState=CLOSED 2023-02-11 19:03:28,117 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208116"}]},"ts":"1676142208116"} 2023-02-11 19:03:28,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:28,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:28,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 44ab9974e56c847afc9182f62f5816e5, disabling compactions & flushes 2023-02-11 19:03:28,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:28,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:28,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. after waiting 0 ms 2023-02-11 19:03:28,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:28,120 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4ec29956dad592ee8609bdd43ea1772f, regionState=CLOSED 2023-02-11 19:03:28,120 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208119"}]},"ts":"1676142208119"} 2023-02-11 19:03:28,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=41 2023-02-11 19:03:28,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=41, state=SUCCESS; CloseRegionProcedure d046f904075ae6356fed6a66a08c65ef, server=jenkins-hbase4.apache.org,45665,1676142194807 in 184 msec 2023-02-11 19:03:28,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:03:28,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=40 2023-02-11 19:03:28,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=40, state=SUCCESS; CloseRegionProcedure 4ec29956dad592ee8609bdd43ea1772f, server=jenkins-hbase4.apache.org,46149,1676142194856 in 181 msec 2023-02-11 19:03:28,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5. 2023-02-11 19:03:28,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 44ab9974e56c847afc9182f62f5816e5: Waiting for close lock at 1676142208117Running coprocessor pre-close hooks at 1676142208117Disabling compacts and flushes for region at 1676142208117Disabling writes for close at 1676142208117Writing region close event to WAL at 1676142208118 (+1 ms)Running coprocessor post-close hooks at 1676142208126 (+8 ms)Closed at 1676142208127 (+1 ms) 2023-02-11 19:03:28,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d046f904075ae6356fed6a66a08c65ef, UNASSIGN in 199 msec 2023-02-11 19:03:28,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010. 2023-02-11 19:03:28,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7ea9b3a72b6b06849cb7fb1b8566b010: Waiting for close lock at 1676142208116Running coprocessor pre-close hooks at 1676142208116Disabling compacts and flushes for region at 1676142208116Disabling writes for close at 1676142208116Writing region close event to WAL at 1676142208121 (+5 ms)Running coprocessor post-close hooks at 1676142208127 (+6 ms)Closed at 1676142208128 (+1 ms) 2023-02-11 19:03:28,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4ec29956dad592ee8609bdd43ea1772f, UNASSIGN in 199 msec 2023-02-11 19:03:28,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:28,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fc84fe42b2a24d860ba23bb2a186feb9, disabling compactions & flushes 2023-02-11 19:03:28,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. after waiting 0 ms 2023-02-11 19:03:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:28,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=44ab9974e56c847afc9182f62f5816e5, regionState=CLOSED 2023-02-11 19:03:28,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142208129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208129"}]},"ts":"1676142208129"} 2023-02-11 19:03:28,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:28,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:28,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 576999b94045f2277f1a4af5553fcbd7, disabling compactions & flushes 2023-02-11 19:03:28,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:28,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:28,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. after waiting 0 ms 2023-02-11 19:03:28,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:28,132 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7ea9b3a72b6b06849cb7fb1b8566b010, regionState=CLOSED 2023-02-11 19:03:28,132 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208131"}]},"ts":"1676142208131"} 2023-02-11 19:03:28,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-11 19:03:28,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 44ab9974e56c847afc9182f62f5816e5, server=jenkins-hbase4.apache.org,46149,1676142194856 in 193 msec 2023-02-11 19:03:28,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-11 19:03:28,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 7ea9b3a72b6b06849cb7fb1b8566b010, server=jenkins-hbase4.apache.org,45665,1676142194807 in 175 msec 2023-02-11 19:03:28,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=44ab9974e56c847afc9182f62f5816e5, UNASSIGN in 208 msec 2023-02-11 19:03:28,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7ea9b3a72b6b06849cb7fb1b8566b010, UNASSIGN in 212 msec 2023-02-11 19:03:28,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9. 2023-02-11 19:03:28,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fc84fe42b2a24d860ba23bb2a186feb9: Waiting for close lock at 1676142208129Running coprocessor pre-close hooks at 1676142208129Disabling compacts and flushes for region at 1676142208129Disabling writes for close at 1676142208129Writing region close event to WAL at 1676142208139 (+10 ms)Running coprocessor post-close hooks at 1676142208146 (+7 ms)Closed at 1676142208146 2023-02-11 19:03:28,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:28,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:28,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e7d22cb62b4f117de686c016c1009e59, disabling compactions & flushes 2023-02-11 19:03:28,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:28,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:28,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. after waiting 0 ms 2023-02-11 19:03:28,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:28,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=fc84fe42b2a24d860ba23bb2a186feb9, regionState=CLOSED 2023-02-11 19:03:28,149 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208149"}]},"ts":"1676142208149"} 2023-02-11 19:03:28,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7. 2023-02-11 19:03:28,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 576999b94045f2277f1a4af5553fcbd7: Waiting for close lock at 1676142208131Running coprocessor pre-close hooks at 1676142208131Disabling compacts and flushes for region at 1676142208131Disabling writes for close at 1676142208131Writing region close event to WAL at 1676142208142 (+11 ms)Running coprocessor post-close hooks at 1676142208149 (+7 ms)Closed at 1676142208150 (+1 ms) 2023-02-11 19:03:28,154 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=576999b94045f2277f1a4af5553fcbd7, regionState=CLOSED 2023-02-11 19:03:28,154 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208154"}]},"ts":"1676142208154"} 2023-02-11 19:03:28,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:28,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:28,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 35c49d2dfa905e03084d83b93e20035d, disabling compactions & flushes 2023-02-11 19:03:28,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:28,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-11 19:03:28,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:28,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. after waiting 0 ms 2023-02-11 19:03:28,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure fc84fe42b2a24d860ba23bb2a186feb9, server=jenkins-hbase4.apache.org,46149,1676142194856 in 212 msec 2023-02-11 19:03:28,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:28,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc84fe42b2a24d860ba23bb2a186feb9, UNASSIGN in 229 msec 2023-02-11 19:03:28,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=42 2023-02-11 19:03:28,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=42, state=SUCCESS; CloseRegionProcedure 576999b94045f2277f1a4af5553fcbd7, server=jenkins-hbase4.apache.org,45665,1676142194807 in 219 msec 2023-02-11 19:03:28,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59. 2023-02-11 19:03:28,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e7d22cb62b4f117de686c016c1009e59: Waiting for close lock at 1676142208149Running coprocessor pre-close hooks at 1676142208149Disabling compacts and flushes for region at 1676142208149Disabling writes for close at 1676142208149Writing region close event to WAL at 1676142208151 (+2 ms)Running coprocessor post-close hooks at 1676142208161 (+10 ms)Closed at 1676142208162 (+1 ms) 2023-02-11 19:03:28,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=576999b94045f2277f1a4af5553fcbd7, UNASSIGN in 232 msec 2023-02-11 19:03:28,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:28,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:28,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c126b1c0300e95aceccfe332563e63fc, disabling compactions & flushes 2023-02-11 19:03:28,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:28,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:28,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. after waiting 0 ms 2023-02-11 19:03:28,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:28,165 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e7d22cb62b4f117de686c016c1009e59, regionState=CLOSED 2023-02-11 19:03:28,165 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208165"}]},"ts":"1676142208165"} 2023-02-11 19:03:28,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d. 2023-02-11 19:03:28,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 35c49d2dfa905e03084d83b93e20035d: Waiting for close lock at 1676142208155Running coprocessor pre-close hooks at 1676142208155Disabling compacts and flushes for region at 1676142208155Disabling writes for close at 1676142208155Writing region close event to WAL at 1676142208160 (+5 ms)Running coprocessor post-close hooks at 1676142208166 (+6 ms)Closed at 1676142208172 (+6 ms) 2023-02-11 19:03:28,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-11 19:03:28,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure e7d22cb62b4f117de686c016c1009e59, server=jenkins-hbase4.apache.org,46149,1676142194856 in 208 msec 2023-02-11 19:03:28,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:28,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:28,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1b17bd65213dcae81dbc9ac62b8fb31b, disabling compactions & flushes 2023-02-11 19:03:28,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:28,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:28,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. after waiting 0 ms 2023-02-11 19:03:28,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:28,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=35c49d2dfa905e03084d83b93e20035d, regionState=CLOSED 2023-02-11 19:03:28,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208176"}]},"ts":"1676142208176"} 2023-02-11 19:03:28,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e7d22cb62b4f117de686c016c1009e59, UNASSIGN in 248 msec 2023-02-11 19:03:28,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=35 2023-02-11 19:03:28,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=35, state=SUCCESS; CloseRegionProcedure 35c49d2dfa905e03084d83b93e20035d, server=jenkins-hbase4.apache.org,45665,1676142194807 in 213 msec 2023-02-11 19:03:28,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=35c49d2dfa905e03084d83b93e20035d, UNASSIGN in 255 msec 2023-02-11 19:03:28,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:28,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:03:28,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc. 2023-02-11 19:03:28,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c126b1c0300e95aceccfe332563e63fc: Waiting for close lock at 1676142208164Running coprocessor pre-close hooks at 1676142208164Disabling compacts and flushes for region at 1676142208164Disabling writes for close at 1676142208165 (+1 ms)Writing region close event to WAL at 1676142208174 (+9 ms)Running coprocessor post-close hooks at 1676142208184 (+10 ms)Closed at 1676142208184 2023-02-11 19:03:28,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b. 2023-02-11 19:03:28,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1b17bd65213dcae81dbc9ac62b8fb31b: Waiting for close lock at 1676142208175Running coprocessor pre-close hooks at 1676142208175Disabling compacts and flushes for region at 1676142208175Disabling writes for close at 1676142208175Writing region close event to WAL at 1676142208176 (+1 ms)Running coprocessor post-close hooks at 1676142208185 (+9 ms)Closed at 1676142208185 2023-02-11 19:03:28,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:28,187 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c126b1c0300e95aceccfe332563e63fc, regionState=CLOSED 2023-02-11 19:03:28,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142208187"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208187"}]},"ts":"1676142208187"} 2023-02-11 19:03:28,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:28,188 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=1b17bd65213dcae81dbc9ac62b8fb31b, regionState=CLOSED 2023-02-11 19:03:28,189 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142208188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142208188"}]},"ts":"1676142208188"} 2023-02-11 19:03:28,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-11 19:03:28,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure c126b1c0300e95aceccfe332563e63fc, server=jenkins-hbase4.apache.org,46149,1676142194856 in 227 msec 2023-02-11 19:03:28,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-11 19:03:28,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure 1b17bd65213dcae81dbc9ac62b8fb31b, server=jenkins-hbase4.apache.org,45665,1676142194807 in 227 msec 2023-02-11 19:03:28,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c126b1c0300e95aceccfe332563e63fc, UNASSIGN in 266 msec 2023-02-11 19:03:28,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=34, resume processing ppid=33 2023-02-11 19:03:28,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1b17bd65213dcae81dbc9ac62b8fb31b, UNASSIGN in 267 msec 2023-02-11 19:03:28,195 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142208195"}]},"ts":"1676142208195"} 2023-02-11 19:03:28,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-11 19:03:28,199 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-11 19:03:28,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 289 msec 2023-02-11 19:03:28,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:28,225 INFO [Listener at localhost/37527] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-11 19:03:28,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-11 19:03:28,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:03:28,240 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:03:28,243 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:03:28,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 19:03:28,262 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:28,262 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:28,262 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:28,263 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:28,263 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:28,263 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:28,263 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:28,263 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:28,269 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/recovered.edits] 2023-02-11 19:03:28,269 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/recovered.edits] 2023-02-11 19:03:28,269 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/recovered.edits] 2023-02-11 19:03:28,270 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/recovered.edits] 2023-02-11 19:03:28,271 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/recovered.edits] 2023-02-11 19:03:28,272 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/recovered.edits] 2023-02-11 19:03:28,272 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/recovered.edits] 2023-02-11 19:03:28,274 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/recovered.edits] 2023-02-11 19:03:28,291 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/3c092dff48f84e9ca32c354f6208deb0 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/3c092dff48f84e9ca32c354f6208deb0 2023-02-11 19:03:28,291 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/716c6be16b8c4843bfe0cc2afbc394e9 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/716c6be16b8c4843bfe0cc2afbc394e9 2023-02-11 19:03:28,291 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/44f3dc4a159141838ce0f227b5b88736 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/44f3dc4a159141838ce0f227b5b88736 2023-02-11 19:03:28,291 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/2ccdcb53bc8749b9831a2b5c0f34b9b7 2023-02-11 19:03:28,292 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/690fb0b127514915b5959e14c44114a0 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/690fb0b127514915b5959e14c44114a0 2023-02-11 19:03:28,294 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/2f547555246f429a96ae27109f27bede to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/2f547555246f429a96ae27109f27bede 2023-02-11 19:03:28,294 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/recovered.edits/6.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b/recovered.edits/6.seqid 2023-02-11 19:03:28,294 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/1f9bf177589045188d63ddaae4cbd3c7 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/1f9bf177589045188d63ddaae4cbd3c7 2023-02-11 19:03:28,297 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/627821d3aa054294afe734afb55a38f2 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f1/627821d3aa054294afe734afb55a38f2 2023-02-11 19:03:28,297 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/4772fe0d3f094a75a6ecf2d59e0c4153 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f1/4772fe0d3f094a75a6ecf2d59e0c4153 2023-02-11 19:03:28,297 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/e092f73301b845aa90a06fb2637e5adf to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f1/e092f73301b845aa90a06fb2637e5adf 2023-02-11 19:03:28,297 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/f28f234237d048298683d692af7bdcac to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f1/f28f234237d048298683d692af7bdcac 2023-02-11 19:03:28,297 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/a66a7e8b010d4b3bb64331c491eb34be to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f1/a66a7e8b010d4b3bb64331c491eb34be 2023-02-11 19:03:28,301 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/36a62f990d3442f69e758a33d66b849f to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f1/36a62f990d3442f69e758a33d66b849f 2023-02-11 19:03:28,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/1b17bd65213dcae81dbc9ac62b8fb31b 2023-02-11 19:03:28,301 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/74158b14dfa940f6a7d80e813a338884 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f1/74158b14dfa940f6a7d80e813a338884 2023-02-11 19:03:28,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:28,306 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/e6a1dbc69c974f8687e65c2fa5f031ab to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/e6a1dbc69c974f8687e65c2fa5f031ab 2023-02-11 19:03:28,308 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/513f365d6a7a4f609460f7cc871fe413 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/513f365d6a7a4f609460f7cc871fe413 2023-02-11 19:03:28,308 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/6ad8f8ba06a74543979ec91268f1e72d to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/6ad8f8ba06a74543979ec91268f1e72d 2023-02-11 19:03:28,309 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/recovered.edits] 2023-02-11 19:03:28,311 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/cff78e9b0ccb44b6b4b06c5bb1d3bd61 2023-02-11 19:03:28,312 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/fd00a0d79b7d40f1a02062d5c9c083fa to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/f2/fd00a0d79b7d40f1a02062d5c9c083fa 2023-02-11 19:03:28,312 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/32f941586a4647faaabf9edff76ea041 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/32f941586a4647faaabf9edff76ea041 2023-02-11 19:03:28,313 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/86ff2fc2ff4349dca432ee34e8613d50 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/86ff2fc2ff4349dca432ee34e8613d50 2023-02-11 19:03:28,313 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/e67df9c486f14145af446496d7e8ec07 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/f2/e67df9c486f14145af446496d7e8ec07 2023-02-11 19:03:28,315 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/f5cf82d474544c029ecd03fb02b111ad to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/f2/f5cf82d474544c029ecd03fb02b111ad 2023-02-11 19:03:28,315 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/5e23742dbbce454784f2a77176994be1 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/5e23742dbbce454784f2a77176994be1 2023-02-11 19:03:28,317 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/676c8ed7236b49cf9aece7c831e919e9 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/f2/676c8ed7236b49cf9aece7c831e919e9 2023-02-11 19:03:28,318 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/fdaf3f1272c74fd1913087f4fbfb7b89 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/f2/fdaf3f1272c74fd1913087f4fbfb7b89 2023-02-11 19:03:28,319 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/d981e6e4f4f24779ae68655f7b317161 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/f2/d981e6e4f4f24779ae68655f7b317161 2023-02-11 19:03:28,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/e3d2aba2007f4f4e8631685ca141c487 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/f2/e3d2aba2007f4f4e8631685ca141c487 2023-02-11 19:03:28,325 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/1098a10bf3a64035b086157c5e0a55e7 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/1098a10bf3a64035b086157c5e0a55e7 2023-02-11 19:03:28,325 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59/recovered.edits/12.seqid 2023-02-11 19:03:28,326 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f/recovered.edits/12.seqid 2023-02-11 19:03:28,327 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/e7d22cb62b4f117de686c016c1009e59 2023-02-11 19:03:28,327 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:28,328 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/4ec29956dad592ee8609bdd43ea1772f 2023-02-11 19:03:28,329 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc/recovered.edits/12.seqid 2023-02-11 19:03:28,329 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef/recovered.edits/12.seqid 2023-02-11 19:03:28,329 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/c126b1c0300e95aceccfe332563e63fc 2023-02-11 19:03:28,330 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/c42c5122873a4091bd42e45293f2146f to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f1/c42c5122873a4091bd42e45293f2146f 2023-02-11 19:03:28,330 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d/recovered.edits/12.seqid 2023-02-11 19:03:28,330 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9/recovered.edits/12.seqid 2023-02-11 19:03:28,331 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/d046f904075ae6356fed6a66a08c65ef 2023-02-11 19:03:28,331 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/35c49d2dfa905e03084d83b93e20035d 2023-02-11 19:03:28,332 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f1, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/f2, FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/recovered.edits] 2023-02-11 19:03:28,332 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/fc84fe42b2a24d860ba23bb2a186feb9 2023-02-11 19:03:28,332 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010/recovered.edits/12.seqid 2023-02-11 19:03:28,333 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/7ea9b3a72b6b06849cb7fb1b8566b010 2023-02-11 19:03:28,335 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/b88af50ea0144814b1583701023f1599 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/b88af50ea0144814b1583701023f1599 2023-02-11 19:03:28,337 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/fe1e8d26916f4678a00d361ca5c8a470 to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/f2/fe1e8d26916f4678a00d361ca5c8a470 2023-02-11 19:03:28,339 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/recovered.edits/6.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5/recovered.edits/6.seqid 2023-02-11 19:03:28,340 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/44ab9974e56c847afc9182f62f5816e5 2023-02-11 19:03:28,341 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/recovered.edits/12.seqid to hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/archive/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7/recovered.edits/12.seqid 2023-02-11 19:03:28,341 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/.tmp/data/default/testWithMapReduce/576999b94045f2277f1a4af5553fcbd7 2023-02-11 19:03:28,341 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 19:03:28,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:03:28,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 19:03:28,372 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-11 19:03:28,376 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-11 19:03:28,378 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:03:28,378 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142208379"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,383 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-11 19:03:28,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1b17bd65213dcae81dbc9ac62b8fb31b, NAME => 'testWithMapReduce,,1676142197804.1b17bd65213dcae81dbc9ac62b8fb31b.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 35c49d2dfa905e03084d83b93e20035d, NAME => 'testWithMapReduce,aaa,1676142197804.35c49d2dfa905e03084d83b93e20035d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => c126b1c0300e95aceccfe332563e63fc, NAME => 'testWithMapReduce,d\x84\x84,1676142197804.c126b1c0300e95aceccfe332563e63fc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 7ea9b3a72b6b06849cb7fb1b8566b010, NAME => 'testWithMapReduce,g\xA7\xA7,1676142197804.7ea9b3a72b6b06849cb7fb1b8566b010.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => e7d22cb62b4f117de686c016c1009e59, NAME => 'testWithMapReduce,j\xCA\xCA,1676142197804.e7d22cb62b4f117de686c016c1009e59.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => fc84fe42b2a24d860ba23bb2a186feb9, NAME => 'testWithMapReduce,m\xED\xED,1676142197804.fc84fe42b2a24d860ba23bb2a186feb9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 4ec29956dad592ee8609bdd43ea1772f, NAME => 'testWithMapReduce,q\x11\x10,1676142197804.4ec29956dad592ee8609bdd43ea1772f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => d046f904075ae6356fed6a66a08c65ef, NAME => 'testWithMapReduce,t43,1676142197804.d046f904075ae6356fed6a66a08c65ef.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 576999b94045f2277f1a4af5553fcbd7, NAME => 'testWithMapReduce,wWV,1676142197804.576999b94045f2277f1a4af5553fcbd7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 44ab9974e56c847afc9182f62f5816e5, NAME => 'testWithMapReduce,zz{,1676142197804.44ab9974e56c847afc9182f62f5816e5.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-11 19:03:28,383 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-11 19:03:28,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676142208383"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:28,389 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-11 19:03:28,391 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:03:28,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 160 msec 2023-02-11 19:03:28,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35183] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 19:03:28,550 INFO [Listener at localhost/37527] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-11 19:03:28,550 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:03:28,550 INFO [Listener at localhost/37527] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:03:28,550 DEBUG [Listener at localhost/37527] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5514a3bb to 127.0.0.1:59241 2023-02-11 19:03:28,550 DEBUG [Listener at localhost/37527] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,551 DEBUG [Listener at localhost/37527] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:03:28,551 DEBUG [Listener at localhost/37527] util.JVMClusterUtil(257): Found active master hash=80596334, stopped=false 2023-02-11 19:03:28,551 INFO [Listener at localhost/37527] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:28,554 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:28,554 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:28,554 INFO [Listener at localhost/37527] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:03:28,554 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:28,554 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:28,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:28,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:28,556 DEBUG [Listener at localhost/37527] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09391391 to 127.0.0.1:59241 2023-02-11 19:03:28,556 DEBUG [Listener at localhost/37527] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:28,556 INFO [Listener at localhost/37527] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45665,1676142194807' ***** 2023-02-11 19:03:28,556 INFO [Listener at localhost/37527] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:28,557 INFO [Listener at localhost/37527] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46149,1676142194856' ***** 2023-02-11 19:03:28,557 INFO [Listener at localhost/37527] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:28,557 INFO [RS:0;jenkins-hbase4:45665] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:28,557 INFO [RS:1;jenkins-hbase4:46149] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:28,557 INFO [RS:0;jenkins-hbase4:45665] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:28,557 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:28,557 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:28,557 INFO [RS:1;jenkins-hbase4:46149] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:28,557 INFO [RS:0;jenkins-hbase4:45665] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:28,558 INFO [RS:1;jenkins-hbase4:46149] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:28,558 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:28,558 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(3304): Received CLOSE for 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:28,558 DEBUG [RS:0;jenkins-hbase4:45665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c122370 to 127.0.0.1:59241 2023-02-11 19:03:28,558 DEBUG [RS:0;jenkins-hbase4:45665] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,558 INFO [RS:0;jenkins-hbase4:45665] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:28,558 INFO [RS:0;jenkins-hbase4:45665] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:28,558 INFO [RS:0;jenkins-hbase4:45665] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:28,558 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:28,558 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:03:28,558 DEBUG [RS:1;jenkins-hbase4:46149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48a6a71d to 127.0.0.1:59241 2023-02-11 19:03:28,559 DEBUG [RS:1;jenkins-hbase4:46149] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3bb74a868c81396c725be5a0e27255b2, disabling compactions & flushes 2023-02-11 19:03:28,559 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 19:03:28,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:28,559 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 19:03:28,559 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1479): Online Regions={3bb74a868c81396c725be5a0e27255b2=hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2.} 2023-02-11 19:03:28,559 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 19:03:28,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:28,560 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:28,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. after waiting 0 ms 2023-02-11 19:03:28,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:28,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:28,560 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:28,560 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:28,560 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:28,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3bb74a868c81396c725be5a0e27255b2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:03:28,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-11 19:03:28,562 DEBUG [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:03:28,562 DEBUG [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1505): Waiting on 3bb74a868c81396c725be5a0e27255b2 2023-02-11 19:03:28,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/.tmp/info/19ba4c5608a5416bad6c21763eb5bde3 2023-02-11 19:03:28,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/.tmp/info/641d272f55424fdc9b0906e6998d2b4e 2023-02-11 19:03:28,595 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:28,595 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:28,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/.tmp/info/19ba4c5608a5416bad6c21763eb5bde3 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/info/19ba4c5608a5416bad6c21763eb5bde3 2023-02-11 19:03:28,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 641d272f55424fdc9b0906e6998d2b4e 2023-02-11 19:03:28,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/info/19ba4c5608a5416bad6c21763eb5bde3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:03:28,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3bb74a868c81396c725be5a0e27255b2 in 54ms, sequenceid=6, compaction requested=false 2023-02-11 19:03:28,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/.tmp/rep_barrier/2fd046e769f540f9af6fb1afa939abdc 2023-02-11 19:03:28,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/namespace/3bb74a868c81396c725be5a0e27255b2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:03:28,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:28,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3bb74a868c81396c725be5a0e27255b2: Waiting for close lock at 1676142208558Running coprocessor pre-close hooks at 1676142208558Disabling compacts and flushes for region at 1676142208559 (+1 ms)Disabling writes for close at 1676142208560 (+1 ms)Obtaining lock to block concurrent updates at 1676142208560Preparing flush snapshotting stores in 3bb74a868c81396c725be5a0e27255b2 at 1676142208560Finished memstore snapshotting hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142208560Flushing stores of hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. at 1676142208561 (+1 ms)Flushing 3bb74a868c81396c725be5a0e27255b2/info: creating writer at 1676142208561Flushing 3bb74a868c81396c725be5a0e27255b2/info: appending metadata at 1676142208564 (+3 ms)Flushing 3bb74a868c81396c725be5a0e27255b2/info: closing flushed file at 1676142208564Flushing 3bb74a868c81396c725be5a0e27255b2/info: reopening flushed file at 1676142208597 (+33 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3bb74a868c81396c725be5a0e27255b2 in 54ms, sequenceid=6, compaction requested=false at 1676142208614 (+17 ms)Writing region close event to WAL at 1676142208617 (+3 ms)Running coprocessor post-close hooks at 1676142208622 (+5 ms)Closed at 1676142208623 (+1 ms) 2023-02-11 19:03:28,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142196927.3bb74a868c81396c725be5a0e27255b2. 2023-02-11 19:03:28,627 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fd046e769f540f9af6fb1afa939abdc 2023-02-11 19:03:28,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/.tmp/table/09bf83df1d364755becb1e82d4c75c21 2023-02-11 19:03:28,649 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09bf83df1d364755becb1e82d4c75c21 2023-02-11 19:03:28,650 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/.tmp/info/641d272f55424fdc9b0906e6998d2b4e as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/info/641d272f55424fdc9b0906e6998d2b4e 2023-02-11 19:03:28,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 641d272f55424fdc9b0906e6998d2b4e 2023-02-11 19:03:28,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/info/641d272f55424fdc9b0906e6998d2b4e, entries=30, sequenceid=57, filesize=7.9 K 2023-02-11 19:03:28,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/.tmp/rep_barrier/2fd046e769f540f9af6fb1afa939abdc as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/rep_barrier/2fd046e769f540f9af6fb1afa939abdc 2023-02-11 19:03:28,665 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fd046e769f540f9af6fb1afa939abdc 2023-02-11 19:03:28,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/rep_barrier/2fd046e769f540f9af6fb1afa939abdc, entries=10, sequenceid=57, filesize=5.9 K 2023-02-11 19:03:28,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/.tmp/table/09bf83df1d364755becb1e82d4c75c21 as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/table/09bf83df1d364755becb1e82d4c75c21 2023-02-11 19:03:28,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09bf83df1d364755becb1e82d4c75c21 2023-02-11 19:03:28,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/table/09bf83df1d364755becb1e82d4c75c21, entries=13, sequenceid=57, filesize=5.9 K 2023-02-11 19:03:28,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 114ms, sequenceid=57, compaction requested=false 2023-02-11 19:03:28,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-11 19:03:28,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:28,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:28,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142208559Running coprocessor pre-close hooks at 1676142208559Disabling compacts and flushes for region at 1676142208559Disabling writes for close at 1676142208560 (+1 ms)Obtaining lock to block concurrent updates at 1676142208560Preparing flush snapshotting stores in 1588230740 at 1676142208560Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676142208560Flushing stores of hbase:meta,,1.1588230740 at 1676142208561 (+1 ms)Flushing 1588230740/info: creating writer at 1676142208561Flushing 1588230740/info: appending metadata at 1676142208567 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676142208567Flushing 1588230740/rep_barrier: creating writer at 1676142208599 (+32 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676142208603 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676142208603Flushing 1588230740/table: creating writer at 1676142208627 (+24 ms)Flushing 1588230740/table: appending metadata at 1676142208630 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676142208630Flushing 1588230740/info: reopening flushed file at 1676142208651 (+21 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676142208660 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1676142208668 (+8 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 114ms, sequenceid=57, compaction requested=false at 1676142208675 (+7 ms)Writing region close event to WAL at 1676142208683 (+8 ms)Running coprocessor post-close hooks at 1676142208687 (+4 ms)Closed at 1676142208688 (+1 ms) 2023-02-11 19:03:28,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:28,762 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45665,1676142194807; all regions closed. 2023-02-11 19:03:28,762 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46149,1676142194856; all regions closed. 2023-02-11 19:03:28,776 DEBUG [RS:1;jenkins-hbase4:46149] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/oldWALs 2023-02-11 19:03:28,776 DEBUG [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/oldWALs 2023-02-11 19:03:28,776 INFO [RS:1;jenkins-hbase4:46149] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46149%2C1676142194856:(num 1676142197338) 2023-02-11 19:03:28,776 INFO [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45665%2C1676142194807.meta:.meta(num 1676142196650) 2023-02-11 19:03:28,776 DEBUG [RS:1;jenkins-hbase4:46149] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,777 INFO [RS:1;jenkins-hbase4:46149] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:28,777 INFO [RS:1;jenkins-hbase4:46149] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:28,777 INFO [RS:1;jenkins-hbase4:46149] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:28,777 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:28,777 INFO [RS:1;jenkins-hbase4:46149] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:28,778 INFO [RS:1;jenkins-hbase4:46149] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:28,779 INFO [RS:1;jenkins-hbase4:46149] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46149 2023-02-11 19:03:28,787 DEBUG [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/oldWALs 2023-02-11 19:03:28,787 INFO [RS:0;jenkins-hbase4:45665] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45665%2C1676142194807:(num 1676142197339) 2023-02-11 19:03:28,787 DEBUG [RS:0;jenkins-hbase4:45665] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,787 INFO [RS:0;jenkins-hbase4:45665] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:28,787 INFO [RS:0;jenkins-hbase4:45665] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:28,788 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:28,788 INFO [RS:0;jenkins-hbase4:45665] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45665 2023-02-11 19:03:28,791 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:28,791 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:28,791 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46149,1676142194856 2023-02-11 19:03:28,791 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:28,791 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:28,792 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e8789f2 rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:28,793 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:28,793 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45665,1676142194807 2023-02-11 19:03:28,793 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5450f353 rejected from java.util.concurrent.ThreadPoolExecutor@506f6d01[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:28,793 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c456197 rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:28,793 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45665,1676142194807] 2023-02-11 19:03:28,794 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45665,1676142194807; numProcessing=1 2023-02-11 19:03:28,796 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45665,1676142194807 already deleted, retry=false 2023-02-11 19:03:28,796 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45665,1676142194807 expired; onlineServers=1 2023-02-11 19:03:28,796 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46149,1676142194856] 2023-02-11 19:03:28,796 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46149,1676142194856; numProcessing=2 2023-02-11 19:03:28,797 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46149,1676142194856 already deleted, retry=false 2023-02-11 19:03:28,797 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46149,1676142194856 expired; onlineServers=0 2023-02-11 19:03:28,797 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35183,1676142193612' ***** 2023-02-11 19:03:28,797 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:03:28,798 DEBUG [M:0;jenkins-hbase4:35183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45f0c755, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:28,798 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35183,1676142193612 2023-02-11 19:03:28,798 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35183,1676142193612; all regions closed. 2023-02-11 19:03:28,798 DEBUG [M:0;jenkins-hbase4:35183] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:28,798 DEBUG [M:0;jenkins-hbase4:35183] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:03:28,800 DEBUG [M:0;jenkins-hbase4:35183] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:03:28,800 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:03:28,800 INFO [M:0;jenkins-hbase4:35183] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:03:28,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142196027] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142196027,5,FailOnTimeoutGroup] 2023-02-11 19:03:28,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142196024] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142196024,5,FailOnTimeoutGroup] 2023-02-11 19:03:28,800 INFO [M:0;jenkins-hbase4:35183] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:03:28,801 INFO [M:0;jenkins-hbase4:35183] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:03:28,801 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:28,801 DEBUG [M:0;jenkins-hbase4:35183] master.HMaster(1502): Stopping service threads 2023-02-11 19:03:28,801 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:28,802 INFO [M:0;jenkins-hbase4:35183] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:03:28,802 ERROR [M:0;jenkins-hbase4:35183] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:03:28,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-11 19:03:28,803 INFO [M:0;jenkins-hbase4:35183] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:03:28,803 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:03:28,804 DEBUG [M:0;jenkins-hbase4:35183] zookeeper.ZKUtil(398): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:03:28,804 WARN [M:0;jenkins-hbase4:35183] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:03:28,804 INFO [M:0;jenkins-hbase4:35183] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:03:28,804 INFO [M:0;jenkins-hbase4:35183] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:03:28,805 DEBUG [M:0;jenkins-hbase4:35183] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:28,805 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:28,805 DEBUG [M:0;jenkins-hbase4:35183] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:28,805 DEBUG [M:0;jenkins-hbase4:35183] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:28,805 DEBUG [M:0;jenkins-hbase4:35183] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:28,805 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.27 KB heapSize=192.19 KB 2023-02-11 19:03:28,955 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:28,955 INFO [RS:0;jenkins-hbase4:45665] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45665,1676142194807; zookeeper connection closed. 2023-02-11 19:03:28,955 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@772bc13a rejected from java.util.concurrent.ThreadPoolExecutor@506f6d01[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:28,956 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:45665-0x10044c412040001, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:28,956 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@211a65be] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@211a65be 2023-02-11 19:03:28,956 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f1e0815 rejected from java.util.concurrent.ThreadPoolExecutor@506f6d01[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:29,056 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:29,056 INFO [RS:1;jenkins-hbase4:46149] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46149,1676142194856; zookeeper connection closed. 2023-02-11 19:03:29,056 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@340a1505 rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:29,056 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40842e1b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40842e1b 2023-02-11 19:03:29,056 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): regionserver:46149-0x10044c412040002, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:29,056 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@683bed3a rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:29,057 INFO [Listener at localhost/37527] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:03:29,222 INFO [M:0;jenkins-hbase4:35183] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.27 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/da74de9aa6554a028d38d30e234b5b2c 2023-02-11 19:03:29,228 DEBUG [M:0;jenkins-hbase4:35183] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/da74de9aa6554a028d38d30e234b5b2c as hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/da74de9aa6554a028d38d30e234b5b2c 2023-02-11 19:03:29,234 INFO [M:0;jenkins-hbase4:35183] regionserver.HStore(1080): Added hdfs://localhost:44011/user/jenkins/test-data/023fda03-fc5c-b346-2f79-cd4c71e9d42e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/da74de9aa6554a028d38d30e234b5b2c, entries=53, sequenceid=357, filesize=10.4 K 2023-02-11 19:03:29,235 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegion(2947): Finished flush of dataSize ~159.27 KB/163094, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 430ms, sequenceid=357, compaction requested=false 2023-02-11 19:03:29,237 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:29,237 DEBUG [M:0;jenkins-hbase4:35183] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142208804Disabling compacts and flushes for region at 1676142208804Disabling writes for close at 1676142208805 (+1 ms)Obtaining lock to block concurrent updates at 1676142208805Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142208805Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163094, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1676142208805Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142208807 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142208807Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142208812 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142208812Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142209229 (+417 ms)Finished flush of dataSize ~159.27 KB/163094, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 430ms, sequenceid=357, compaction requested=false at 1676142209235 (+6 ms)Writing region close event to WAL at 1676142209237 (+2 ms)Closed at 1676142209237 2023-02-11 19:03:29,240 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:29,240 INFO [M:0;jenkins-hbase4:35183] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:03:29,241 INFO [M:0;jenkins-hbase4:35183] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35183 2023-02-11 19:03:29,278 DEBUG [M:0;jenkins-hbase4:35183] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35183,1676142193612 already deleted, retry=false 2023-02-11 19:03:29,380 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:29,380 INFO [M:0;jenkins-hbase4:35183] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35183,1676142193612; zookeeper connection closed. 2023-02-11 19:03:29,380 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@436a237c rejected from java.util.concurrent.ThreadPoolExecutor@736c297e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:29,380 DEBUG [Listener at localhost/37527-EventThread] zookeeper.ZKWatcher(600): master:35183-0x10044c412040000, quorum=127.0.0.1:59241, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:29,380 ERROR [Listener at localhost/37527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68bed846 rejected from java.util.concurrent.ThreadPoolExecutor@736c297e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:29,382 WARN [Listener at localhost/37527] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:29,390 INFO [Listener at localhost/37527] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:29,390 WARN [547479433@qtp-1909707358-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44333] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-02-11 19:03:29,390 WARN [547479433@qtp-1909707358-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44333] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-02-11 19:03:29,493 WARN [BP-1844961752-172.31.14.131-1676142189830 heartbeating to localhost/127.0.0.1:44011] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:29,493 WARN [BP-1844961752-172.31.14.131-1676142189830 heartbeating to localhost/127.0.0.1:44011] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1844961752-172.31.14.131-1676142189830 (Datanode Uuid 58bf8f62-0565-4326-bc0e-0f0bd52ddbe6) service to localhost/127.0.0.1:44011 2023-02-11 19:03:29,495 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/dfs/data/data3/current/BP-1844961752-172.31.14.131-1676142189830] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:29,496 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/dfs/data/data4/current/BP-1844961752-172.31.14.131-1676142189830] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:29,498 WARN [Listener at localhost/37527] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:29,500 INFO [Listener at localhost/37527] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:29,604 WARN [BP-1844961752-172.31.14.131-1676142189830 heartbeating to localhost/127.0.0.1:44011] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:29,605 WARN [BP-1844961752-172.31.14.131-1676142189830 heartbeating to localhost/127.0.0.1:44011] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1844961752-172.31.14.131-1676142189830 (Datanode Uuid a8269ed7-e33a-44a0-aad6-80c5155f6057) service to localhost/127.0.0.1:44011 2023-02-11 19:03:29,605 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/dfs/data/data1/current/BP-1844961752-172.31.14.131-1676142189830] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:29,606 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/cluster_54a32c72-1bf6-d952-95eb-eccc751e764b/dfs/data/data2/current/BP-1844961752-172.31.14.131-1676142189830] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:29,642 INFO [Listener at localhost/37527] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:29,765 INFO [Listener at localhost/37527] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:03:29,843 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:03:29,862 INFO [Listener at localhost/37527] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44011 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@4f3ce80f java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:44011 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44011 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35183,1676142193612)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44011 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44011 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37527 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=545 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 229) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=4194 (was 5242) 2023-02-11 19:03:29,875 INFO [Listener at localhost/37527] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=545, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=167, AvailableMemoryMB=4194 2023-02-11 19:03:29,888 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop.log.dir so I do NOT create it in target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030 2023-02-11 19:03:29,888 WARN [Listener at localhost/37527] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 19:03:29,888 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop.tmp.dir so I do NOT create it in target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030 2023-02-11 19:03:29,888 WARN [Listener at localhost/37527] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/76801ea5-e736-e1ad-bf36-79c5c658eb46/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 19:03:29,888 DEBUG [Listener at localhost/37527] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030 2023-02-11 19:03:29,888 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:03:29,888 INFO [Listener at localhost/37527] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e, deleteOnExit=true 2023-02-11 19:03:29,888 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:03:29,889 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/test.cache.data in system properties and HBase conf 2023-02-11 19:03:29,889 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:03:29,889 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:03:29,889 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:03:29,889 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:03:29,889 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:03:29,889 DEBUG [Listener at localhost/37527] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:03:29,890 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:03:29,891 INFO [Listener at localhost/37527] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:03:29,896 WARN [Listener at localhost/37527] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:29,896 WARN [Listener at localhost/37527] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:29,942 WARN [Listener at localhost/37527] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:29,944 INFO [Listener at localhost/37527] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:29,950 INFO [Listener at localhost/37527] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/java.io.tmpdir/Jetty_localhost_43855_hdfs____2nnm3n/webapp 2023-02-11 19:03:30,062 INFO [Listener at localhost/37527] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43855 2023-02-11 19:03:30,067 WARN [Listener at localhost/37527] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:30,067 WARN [Listener at localhost/37527] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:30,123 WARN [Listener at localhost/33995] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:30,146 WARN [Listener at localhost/33995] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:30,149 WARN [Listener at localhost/33995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:30,150 INFO [Listener at localhost/33995] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:30,157 INFO [Listener at localhost/33995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/java.io.tmpdir/Jetty_localhost_42725_datanode____.c9mp3x/webapp 2023-02-11 19:03:30,260 INFO [Listener at localhost/33995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42725 2023-02-11 19:03:30,272 WARN [Listener at localhost/35201] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:30,287 WARN [Listener at localhost/35201] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:30,290 WARN [Listener at localhost/35201] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:30,291 INFO [Listener at localhost/35201] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:30,295 INFO [Listener at localhost/35201] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/java.io.tmpdir/Jetty_localhost_38453_datanode____.xf6d70/webapp 2023-02-11 19:03:30,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc9fdc3590622f4fa: Processing first storage report for DS-9228f511-2e1c-485c-8e62-6adced582128 from datanode 0b8f4d0d-782b-4acf-9111-c0c1c38a0704 2023-02-11 19:03:30,402 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc9fdc3590622f4fa: from storage DS-9228f511-2e1c-485c-8e62-6adced582128 node DatanodeRegistration(127.0.0.1:39251, datanodeUuid=0b8f4d0d-782b-4acf-9111-c0c1c38a0704, infoPort=43515, infoSecurePort=0, ipcPort=35201, storageInfo=lv=-57;cid=testClusterID;nsid=1173570124;c=1676142209899), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:30,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc9fdc3590622f4fa: Processing first storage report for DS-e092293b-7fbf-49be-958b-86c5cb3b5b0d from datanode 0b8f4d0d-782b-4acf-9111-c0c1c38a0704 2023-02-11 19:03:30,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc9fdc3590622f4fa: from storage DS-e092293b-7fbf-49be-958b-86c5cb3b5b0d node DatanodeRegistration(127.0.0.1:39251, datanodeUuid=0b8f4d0d-782b-4acf-9111-c0c1c38a0704, infoPort=43515, infoSecurePort=0, ipcPort=35201, storageInfo=lv=-57;cid=testClusterID;nsid=1173570124;c=1676142209899), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:30,423 INFO [Listener at localhost/35201] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38453 2023-02-11 19:03:30,440 WARN [Listener at localhost/34971] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:30,558 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ac35f8ddf959573: Processing first storage report for DS-1ec463a8-3bc4-4039-886a-ca32446401cc from datanode b5592239-aaa1-4287-89c6-3fb814bbf783 2023-02-11 19:03:30,558 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ac35f8ddf959573: from storage DS-1ec463a8-3bc4-4039-886a-ca32446401cc node DatanodeRegistration(127.0.0.1:33363, datanodeUuid=b5592239-aaa1-4287-89c6-3fb814bbf783, infoPort=39753, infoSecurePort=0, ipcPort=34971, storageInfo=lv=-57;cid=testClusterID;nsid=1173570124;c=1676142209899), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:30,558 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ac35f8ddf959573: Processing first storage report for DS-ef863ea7-13c6-4040-9fd0-1cc526b7c2a0 from datanode b5592239-aaa1-4287-89c6-3fb814bbf783 2023-02-11 19:03:30,558 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ac35f8ddf959573: from storage DS-ef863ea7-13c6-4040-9fd0-1cc526b7c2a0 node DatanodeRegistration(127.0.0.1:33363, datanodeUuid=b5592239-aaa1-4287-89c6-3fb814bbf783, infoPort=39753, infoSecurePort=0, ipcPort=34971, storageInfo=lv=-57;cid=testClusterID;nsid=1173570124;c=1676142209899), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:30,658 DEBUG [Listener at localhost/34971] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030 2023-02-11 19:03:30,660 INFO [Listener at localhost/34971] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/zookeeper_0, clientPort=53493, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:03:30,663 INFO [Listener at localhost/34971] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53493 2023-02-11 19:03:30,663 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,665 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,685 INFO [Listener at localhost/34971] util.FSUtils(479): Created version file at hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea with version=8 2023-02-11 19:03:30,686 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,687 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,689 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/hbase-staging 2023-02-11 19:03:30,691 INFO [Listener at localhost/34971] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:30,691 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,692 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,692 INFO [Listener at localhost/34971] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:30,692 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,692 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:30,692 INFO [Listener at localhost/34971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:30,694 INFO [Listener at localhost/34971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38695 2023-02-11 19:03:30,695 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,696 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,697 INFO [Listener at localhost/34971] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38695 connecting to ZooKeeper ensemble=127.0.0.1:53493 2023-02-11 19:03:30,716 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:386950x0, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:30,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38695-0x10044c458280000 connected 2023-02-11 19:03:30,738 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:30,739 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:30,740 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:30,740 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38695 2023-02-11 19:03:30,740 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38695 2023-02-11 19:03:30,741 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38695 2023-02-11 19:03:30,741 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38695 2023-02-11 19:03:30,741 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38695 2023-02-11 19:03:30,741 INFO [Listener at localhost/34971] master.HMaster(439): hbase.rootdir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea, hbase.cluster.distributed=false 2023-02-11 19:03:30,758 INFO [Listener at localhost/34971] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:30,758 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,758 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,758 INFO [Listener at localhost/34971] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:30,758 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,758 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:30,759 INFO [Listener at localhost/34971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:30,762 INFO [Listener at localhost/34971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44767 2023-02-11 19:03:30,763 INFO [Listener at localhost/34971] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:30,769 DEBUG [Listener at localhost/34971] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:30,770 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,771 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,772 INFO [Listener at localhost/34971] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44767 connecting to ZooKeeper ensemble=127.0.0.1:53493 2023-02-11 19:03:30,783 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:447670x0, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:30,784 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:447670x0, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:30,785 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:447670x0, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:30,785 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:447670x0, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:30,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44767-0x10044c458280001 connected 2023-02-11 19:03:30,789 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44767 2023-02-11 19:03:30,804 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44767 2023-02-11 19:03:30,810 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44767 2023-02-11 19:03:30,810 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44767 2023-02-11 19:03:30,810 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44767 2023-02-11 19:03:30,828 INFO [Listener at localhost/34971] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:30,828 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,829 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,829 INFO [Listener at localhost/34971] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:30,829 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:30,829 INFO [Listener at localhost/34971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:30,829 INFO [Listener at localhost/34971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:30,833 INFO [Listener at localhost/34971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41511 2023-02-11 19:03:30,833 INFO [Listener at localhost/34971] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:30,834 DEBUG [Listener at localhost/34971] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:30,835 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,836 INFO [Listener at localhost/34971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,837 INFO [Listener at localhost/34971] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41511 connecting to ZooKeeper ensemble=127.0.0.1:53493 2023-02-11 19:03:30,843 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:415110x0, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:30,843 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:415110x0, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:30,844 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:415110x0, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:30,844 DEBUG [Listener at localhost/34971] zookeeper.ZKUtil(164): regionserver:415110x0, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:30,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41511-0x10044c458280002 connected 2023-02-11 19:03:30,860 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41511 2023-02-11 19:03:30,861 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41511 2023-02-11 19:03:30,864 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41511 2023-02-11 19:03:30,868 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41511 2023-02-11 19:03:30,869 DEBUG [Listener at localhost/34971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41511 2023-02-11 19:03:30,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:30,875 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:30,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:30,877 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:30,877 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:30,877 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:30,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:30,879 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:30,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:30,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38695,1676142210691 from backup master directory 2023-02-11 19:03:30,883 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:30,883 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:30,883 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:30,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:30,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/hbase.id with ID: a8231553-cef0-4141-9243-83681cb8f95e 2023-02-11 19:03:30,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:30,926 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:30,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x257080d7 to 127.0.0.1:53493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:30,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@700feeb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:30,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:30,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:03:30,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:30,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store-tmp 2023-02-11 19:03:30,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:30,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:30,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:30,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:30,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:30,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:30,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:30,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142210983Disabling compacts and flushes for region at 1676142210983Disabling writes for close at 1676142210984 (+1 ms)Writing region close event to WAL at 1676142210984Closed at 1676142210984 2023-02-11 19:03:30,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/WALs/jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:30,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38695%2C1676142210691, suffix=, logDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/WALs/jenkins-hbase4.apache.org,38695,1676142210691, archiveDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/oldWALs, maxLogs=10 2023-02-11 19:03:31,014 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK] 2023-02-11 19:03:31,017 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK] 2023-02-11 19:03:31,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/WALs/jenkins-hbase4.apache.org,38695,1676142210691/jenkins-hbase4.apache.org%2C38695%2C1676142210691.1676142210988 2023-02-11 19:03:31,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK], DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK]] 2023-02-11 19:03:31,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:31,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:31,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:31,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:31,026 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:31,028 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:03:31,028 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:03:31,029 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:31,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:31,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:31,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:31,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67856801, jitterRate=0.011145129799842834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:31,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142211024Initializing all the Stores at 1676142211026 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142211026Cleaning up temporary data from old regions at 1676142211031 (+5 ms)Cleaning up detritus from prior splits at 1676142211031Region opened successfully at 1676142211036 (+5 ms) 2023-02-11 19:03:31,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:03:31,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:03:31,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:03:31,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:03:31,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 19:03:31,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 4 msec 2023-02-11 19:03:31,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:03:31,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:03:31,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:03:31,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:03:31,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:03:31,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:03:31,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:03:31,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:03:31,063 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:31,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:03:31,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:03:31,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:03:31,066 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:31,066 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:31,066 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:31,066 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:31,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,38695,1676142210691, sessionid=0x10044c458280000, setting cluster-up flag (Was=false) 2023-02-11 19:03:31,073 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:31,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:03:31,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:31,084 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:31,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:03:31,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:31,091 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.hbase-snapshot/.tmp 2023-02-11 19:03:31,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:31,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142241106 2023-02-11 19:03:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:03:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:03:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:03:31,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:03:31,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:03:31,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:03:31,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,107 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:31,107 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:03:31,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:03:31,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:03:31,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:03:31,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:03:31,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:03:31,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142211108,5,FailOnTimeoutGroup] 2023-02-11 19:03:31,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142211109,5,FailOnTimeoutGroup] 2023-02-11 19:03:31,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:03:31,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,110 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:31,122 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:31,123 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:31,123 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea 2023-02-11 19:03:31,130 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:31,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:31,133 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/info 2023-02-11 19:03:31,133 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:31,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:31,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:31,136 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:31,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:31,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/table 2023-02-11 19:03:31,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:31,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,141 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740 2023-02-11 19:03:31,141 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740 2023-02-11 19:03:31,143 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:31,145 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:31,147 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:31,147 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73974360, jitterRate=0.10230386257171631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:31,147 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142211130Initializing all the Stores at 1676142211131 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142211131Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142211131Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142211131Cleaning up temporary data from old regions at 1676142211142 (+11 ms)Cleaning up detritus from prior splits at 1676142211143 (+1 ms)Region opened successfully at 1676142211147 (+4 ms) 2023-02-11 19:03:31,147 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:31,148 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:31,148 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:31,148 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:31,148 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:31,148 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:31,148 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142211147Disabling compacts and flushes for region at 1676142211147Disabling writes for close at 1676142211148 (+1 ms)Writing region close event to WAL at 1676142211148Closed at 1676142211148 2023-02-11 19:03:31,149 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:31,149 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:03:31,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:03:31,156 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:03:31,157 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:03:31,171 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(952): ClusterId : a8231553-cef0-4141-9243-83681cb8f95e 2023-02-11 19:03:31,171 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:31,172 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(952): ClusterId : a8231553-cef0-4141-9243-83681cb8f95e 2023-02-11 19:03:31,172 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:31,174 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:31,174 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:31,174 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:31,174 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:31,178 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:31,179 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:31,180 DEBUG [RS:0;jenkins-hbase4:44767] zookeeper.ReadOnlyZKClient(139): Connect 0x33dc6d52 to 127.0.0.1:53493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:31,180 DEBUG [RS:1;jenkins-hbase4:41511] zookeeper.ReadOnlyZKClient(139): Connect 0x53ec0a19 to 127.0.0.1:53493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:31,196 DEBUG [RS:1;jenkins-hbase4:41511] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d2bfe14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:31,196 DEBUG [RS:0;jenkins-hbase4:44767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d1b9559, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:31,196 DEBUG [RS:1;jenkins-hbase4:41511] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59146169, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:31,196 DEBUG [RS:0;jenkins-hbase4:44767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39240622, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:31,210 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44767 2023-02-11 19:03:31,210 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41511 2023-02-11 19:03:31,210 INFO [RS:0;jenkins-hbase4:44767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:31,210 INFO [RS:0;jenkins-hbase4:44767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:31,210 INFO [RS:1;jenkins-hbase4:41511] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:31,210 INFO [RS:1;jenkins-hbase4:41511] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:31,210 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:31,211 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:31,212 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38695,1676142210691 with isa=jenkins-hbase4.apache.org/172.31.14.131:44767, startcode=1676142210757 2023-02-11 19:03:31,212 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38695,1676142210691 with isa=jenkins-hbase4.apache.org/172.31.14.131:41511, startcode=1676142210828 2023-02-11 19:03:31,212 DEBUG [RS:0;jenkins-hbase4:44767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:31,212 DEBUG [RS:1;jenkins-hbase4:41511] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:31,217 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33739, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:31,217 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55503, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:31,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38695] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,219 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea 2023-02-11 19:03:31,219 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33995 2023-02-11 19:03:31,219 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:31,220 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea 2023-02-11 19:03:31,220 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33995 2023-02-11 19:03:31,220 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:31,221 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:31,226 DEBUG [RS:0;jenkins-hbase4:44767] zookeeper.ZKUtil(162): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,226 WARN [RS:0;jenkins-hbase4:44767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:31,226 DEBUG [RS:1;jenkins-hbase4:41511] zookeeper.ZKUtil(162): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,226 INFO [RS:0;jenkins-hbase4:44767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:31,226 WARN [RS:1;jenkins-hbase4:41511] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:31,226 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,226 INFO [RS:1;jenkins-hbase4:41511] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:31,227 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,233 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41511,1676142210828] 2023-02-11 19:03:31,233 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44767,1676142210757] 2023-02-11 19:03:31,242 DEBUG [RS:0;jenkins-hbase4:44767] zookeeper.ZKUtil(162): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,242 DEBUG [RS:0;jenkins-hbase4:44767] zookeeper.ZKUtil(162): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,244 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:31,244 INFO [RS:0;jenkins-hbase4:44767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:31,248 DEBUG [RS:1;jenkins-hbase4:41511] zookeeper.ZKUtil(162): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,248 DEBUG [RS:1;jenkins-hbase4:41511] zookeeper.ZKUtil(162): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,249 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:31,249 INFO [RS:1;jenkins-hbase4:41511] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:31,257 INFO [RS:0;jenkins-hbase4:44767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:31,257 INFO [RS:1;jenkins-hbase4:41511] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:31,257 INFO [RS:0;jenkins-hbase4:44767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:31,257 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,258 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:31,258 INFO [RS:1;jenkins-hbase4:41511] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:31,258 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,258 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:31,260 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,260 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,260 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,260 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,260 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,261 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,261 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:31,261 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,261 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,261 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,261 DEBUG [RS:0;jenkins-hbase4:44767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,262 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,262 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,262 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,263 DEBUG [RS:1;jenkins-hbase4:41511] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:31,264 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,264 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,264 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,268 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,268 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,268 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,281 INFO [RS:1;jenkins-hbase4:41511] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:31,281 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41511,1676142210828-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,283 INFO [RS:0;jenkins-hbase4:44767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:31,283 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44767,1676142210757-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,292 INFO [RS:1;jenkins-hbase4:41511] regionserver.Replication(203): jenkins-hbase4.apache.org,41511,1676142210828 started 2023-02-11 19:03:31,292 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41511,1676142210828, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41511, sessionid=0x10044c458280002 2023-02-11 19:03:31,292 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:31,292 DEBUG [RS:1;jenkins-hbase4:41511] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,292 DEBUG [RS:1;jenkins-hbase4:41511] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41511,1676142210828' 2023-02-11 19:03:31,292 DEBUG [RS:1;jenkins-hbase4:41511] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:31,293 DEBUG [RS:1;jenkins-hbase4:41511] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:31,293 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:31,293 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:31,293 DEBUG [RS:1;jenkins-hbase4:41511] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,293 DEBUG [RS:1;jenkins-hbase4:41511] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41511,1676142210828' 2023-02-11 19:03:31,293 DEBUG [RS:1;jenkins-hbase4:41511] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:31,294 DEBUG [RS:1;jenkins-hbase4:41511] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:31,294 DEBUG [RS:1;jenkins-hbase4:41511] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:31,294 INFO [RS:1;jenkins-hbase4:41511] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:31,294 INFO [RS:1;jenkins-hbase4:41511] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:31,299 INFO [RS:0;jenkins-hbase4:44767] regionserver.Replication(203): jenkins-hbase4.apache.org,44767,1676142210757 started 2023-02-11 19:03:31,299 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44767,1676142210757, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44767, sessionid=0x10044c458280001 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44767,1676142210757' 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:31,300 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:31,301 DEBUG [RS:0;jenkins-hbase4:44767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:31,301 DEBUG [RS:0;jenkins-hbase4:44767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44767,1676142210757' 2023-02-11 19:03:31,301 DEBUG [RS:0;jenkins-hbase4:44767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:31,301 DEBUG [RS:0;jenkins-hbase4:44767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:31,301 DEBUG [RS:0;jenkins-hbase4:44767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:31,301 INFO [RS:0;jenkins-hbase4:44767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:31,301 INFO [RS:0;jenkins-hbase4:44767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:31,308 DEBUG [jenkins-hbase4:38695] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:03:31,308 DEBUG [jenkins-hbase4:38695] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:31,310 DEBUG [jenkins-hbase4:38695] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:31,310 DEBUG [jenkins-hbase4:38695] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:31,310 DEBUG [jenkins-hbase4:38695] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:31,311 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41511,1676142210828, state=OPENING 2023-02-11 19:03:31,312 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:03:31,314 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:31,314 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:31,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:31,469 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,470 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:31,473 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:31,478 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:03:31,478 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:31,479 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41511%2C1676142210828.meta, suffix=.meta, logDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,41511,1676142210828, archiveDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/oldWALs, maxLogs=32 2023-02-11 19:03:31,496 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK] 2023-02-11 19:03:31,497 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK] 2023-02-11 19:03:31,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,41511,1676142210828/jenkins-hbase4.apache.org%2C41511%2C1676142210828.meta.1676142211481.meta 2023-02-11 19:03:31,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK], DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK]] 2023-02-11 19:03:31,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:31,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:03:31,500 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:03:31,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:03:31,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:03:31,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:31,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:03:31,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:03:31,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:31,503 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/info 2023-02-11 19:03:31,503 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/info 2023-02-11 19:03:31,503 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:31,504 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,504 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:31,505 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:31,505 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:31,506 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:31,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:31,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/table 2023-02-11 19:03:31,508 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/table 2023-02-11 19:03:31,508 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:31,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740 2023-02-11 19:03:31,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740 2023-02-11 19:03:31,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:31,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:31,516 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64972754, jitterRate=-0.03183051943778992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:31,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142211501Writing region info on filesystem at 1676142211501Initializing all the Stores at 1676142211502 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142211502Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142211502Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142211502Cleaning up temporary data from old regions at 1676142211512 (+10 ms)Cleaning up detritus from prior splits at 1676142211512Running coprocessor post-open hooks at 1676142211516 (+4 ms)Region opened successfully at 1676142211516 2023-02-11 19:03:31,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142211469 2023-02-11 19:03:31,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:03:31,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:03:31,522 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41511,1676142210828, state=OPEN 2023-02-11 19:03:31,524 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:03:31,524 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:31,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:03:31,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41511,1676142210828 in 210 msec 2023-02-11 19:03:31,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:03:31,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 377 msec 2023-02-11 19:03:31,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 436 msec 2023-02-11 19:03:31,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142210876, completionTime=-1 2023-02-11 19:03:31,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:03:31,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:03:31,533 DEBUG [hconnection-0x5bd75127-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:31,535 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:03:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142271537 2023-02-11 19:03:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142331537 2023-02-11 19:03:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-11 19:03:31,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38695,1676142210691-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38695,1676142210691-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38695,1676142210691-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38695, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:31,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:03:31,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:31,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:03:31,548 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:31,549 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:03:31,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:31,551 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,552 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7 empty. 2023-02-11 19:03:31,552 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:03:31,569 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:31,570 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 09e130595a19adb578ec79999ae2a5a7, NAME => 'hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:31,584 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:31,584 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 09e130595a19adb578ec79999ae2a5a7, disabling compactions & flushes 2023-02-11 19:03:31,584 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,584 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,584 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. after waiting 0 ms 2023-02-11 19:03:31,584 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,584 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,585 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 09e130595a19adb578ec79999ae2a5a7: Waiting for close lock at 1676142211584Disabling compacts and flushes for region at 1676142211584Disabling writes for close at 1676142211584Writing region close event to WAL at 1676142211584Closed at 1676142211584 2023-02-11 19:03:31,587 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:31,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142211588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142211588"}]},"ts":"1676142211588"} 2023-02-11 19:03:31,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:31,592 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:31,592 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142211592"}]},"ts":"1676142211592"} 2023-02-11 19:03:31,594 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:03:31,597 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:31,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:31,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:31,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:31,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=09e130595a19adb578ec79999ae2a5a7, ASSIGN}] 2023-02-11 19:03:31,601 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=09e130595a19adb578ec79999ae2a5a7, ASSIGN 2023-02-11 19:03:31,602 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=09e130595a19adb578ec79999ae2a5a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41511,1676142210828; forceNewPlan=false, retain=false 2023-02-11 19:03:31,752 INFO [jenkins-hbase4:38695] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:31,753 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=09e130595a19adb578ec79999ae2a5a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,753 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142211753"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142211753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142211753"}]},"ts":"1676142211753"} 2023-02-11 19:03:31,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 09e130595a19adb578ec79999ae2a5a7, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:31,911 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,913 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41511%2C1676142210828, suffix=, logDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,41511,1676142210828, archiveDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/oldWALs, maxLogs=32 2023-02-11 19:03:31,931 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK] 2023-02-11 19:03:31,933 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK] 2023-02-11 19:03:31,935 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,41511,1676142210828/jenkins-hbase4.apache.org%2C41511%2C1676142210828.1676142211914 2023-02-11 19:03:31,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK], DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK]] 2023-02-11 19:03:31,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 09e130595a19adb578ec79999ae2a5a7, NAME => 'hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:31,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:31,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,937 INFO [StoreOpener-09e130595a19adb578ec79999ae2a5a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,938 DEBUG [StoreOpener-09e130595a19adb578ec79999ae2a5a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/info 2023-02-11 19:03:31,938 DEBUG [StoreOpener-09e130595a19adb578ec79999ae2a5a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/info 2023-02-11 19:03:31,939 INFO [StoreOpener-09e130595a19adb578ec79999ae2a5a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09e130595a19adb578ec79999ae2a5a7 columnFamilyName info 2023-02-11 19:03:31,939 INFO [StoreOpener-09e130595a19adb578ec79999ae2a5a7-1] regionserver.HStore(310): Store=09e130595a19adb578ec79999ae2a5a7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:31,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:31,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:31,945 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 09e130595a19adb578ec79999ae2a5a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70917423, jitterRate=0.056751951575279236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:31,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 09e130595a19adb578ec79999ae2a5a7: Running coprocessor pre-open hook at 1676142211936Writing region info on filesystem at 1676142211936Initializing all the Stores at 1676142211936Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142211936Cleaning up temporary data from old regions at 1676142211941 (+5 ms)Cleaning up detritus from prior splits at 1676142211941Running coprocessor post-open hooks at 1676142211945 (+4 ms)Region opened successfully at 1676142211945 2023-02-11 19:03:31,946 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7., pid=6, masterSystemTime=1676142211908 2023-02-11 19:03:31,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,949 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:31,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=09e130595a19adb578ec79999ae2a5a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:31,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142211949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142211949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142211949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142211949"}]},"ts":"1676142211949"} 2023-02-11 19:03:31,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:03:31,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 09e130595a19adb578ec79999ae2a5a7, server=jenkins-hbase4.apache.org,41511,1676142210828 in 195 msec 2023-02-11 19:03:31,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:03:31,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=09e130595a19adb578ec79999ae2a5a7, ASSIGN in 355 msec 2023-02-11 19:03:31,956 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:31,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142211956"}]},"ts":"1676142211956"} 2023-02-11 19:03:31,958 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:03:31,962 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:31,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 417 msec 2023-02-11 19:03:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:03:32,049 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:32,049 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:32,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:03:32,063 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:32,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-11 19:03:32,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:03:32,086 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:32,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-11 19:03:32,102 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:03:32,106 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.223sec 2023-02-11 19:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38695,1676142210691-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38695,1676142210691-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:03:32,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:03:32,172 DEBUG [Listener at localhost/34971] zookeeper.ReadOnlyZKClient(139): Connect 0x5e91186f to 127.0.0.1:53493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:32,177 DEBUG [Listener at localhost/34971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42dde959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:32,178 DEBUG [hconnection-0x216de13d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:32,181 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58680, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:32,182 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:32,183 DEBUG [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:03:32,184 DEBUG [Listener at localhost/34971] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:03:32,186 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:03:32,187 INFO [Listener at localhost/34971] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 19:03:32,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 19:03:32,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:03:32,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:37962 deadline: 1676142272187, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 19:03:32,188 INFO [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 19:03:32,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:32,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 19:03:32,193 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:32,193 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 19:03:32,194 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:32,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:32,202 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc empty. 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708 empty. 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac empty. 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12 empty. 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0 empty. 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603 empty. 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:32,203 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34 empty. 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132 empty. 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91 empty. 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa empty. 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:32,204 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:32,205 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:32,205 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:32,205 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 19:03:32,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:32,303 INFO [RS:0;jenkins-hbase4:44767] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44767%2C1676142210757, suffix=, logDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,44767,1676142210757, archiveDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/oldWALs, maxLogs=32 2023-02-11 19:03:32,321 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK] 2023-02-11 19:03:32,321 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK] 2023-02-11 19:03:32,323 INFO [RS:0;jenkins-hbase4:44767] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/WALs/jenkins-hbase4.apache.org,44767,1676142210757/jenkins-hbase4.apache.org%2C44767%2C1676142210757.1676142212304 2023-02-11 19:03:32,323 DEBUG [RS:0;jenkins-hbase4:44767] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33363,DS-1ec463a8-3bc4-4039-886a-ca32446401cc,DISK], DatanodeInfoWithStorage[127.0.0.1:39251,DS-9228f511-2e1c-485c-8e62-6adced582128,DISK]] 2023-02-11 19:03:32,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:32,626 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:32,648 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => de0005f8ed15524083f68c4a7bfdd603, NAME => 'testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,660 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9759e84fac8e33c759a4af887e07bd34, NAME => 'testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,664 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0f948dab103d347915da84203011fbdc, NAME => 'testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,719 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,720 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing de0005f8ed15524083f68c4a7bfdd603, disabling compactions & flushes 2023-02-11 19:03:32,720 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:32,720 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:32,720 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. after waiting 0 ms 2023-02-11 19:03:32,720 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:32,720 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:32,720 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for de0005f8ed15524083f68c4a7bfdd603: Waiting for close lock at 1676142212720Disabling compacts and flushes for region at 1676142212720Disabling writes for close at 1676142212720Writing region close event to WAL at 1676142212720Closed at 1676142212720 2023-02-11 19:03:32,720 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92d401a14d25c8dbf740d2b4625c54ac, NAME => 'testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0f948dab103d347915da84203011fbdc, disabling compactions & flushes 2023-02-11 19:03:32,722 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:32,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:32,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. after waiting 0 ms 2023-02-11 19:03:32,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:32,722 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:32,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0f948dab103d347915da84203011fbdc: Waiting for close lock at 1676142212722Disabling compacts and flushes for region at 1676142212722Disabling writes for close at 1676142212722Writing region close event to WAL at 1676142212722Closed at 1676142212722 2023-02-11 19:03:32,722 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 960b83fab17e015bbd62d62dd0c9d132, NAME => 'testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 92d401a14d25c8dbf740d2b4625c54ac, disabling compactions & flushes 2023-02-11 19:03:32,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:32,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:32,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. after waiting 0 ms 2023-02-11 19:03:32,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:32,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:32,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 92d401a14d25c8dbf740d2b4625c54ac: Waiting for close lock at 1676142212730Disabling compacts and flushes for region at 1676142212730Disabling writes for close at 1676142212731 (+1 ms)Writing region close event to WAL at 1676142212731Closed at 1676142212731 2023-02-11 19:03:32,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d1328515bb4b6d89d2e0001e6e49fa12, NAME => 'testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d1328515bb4b6d89d2e0001e6e49fa12, disabling compactions & flushes 2023-02-11 19:03:32,739 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:32,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:32,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. after waiting 0 ms 2023-02-11 19:03:32,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:32,739 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:32,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d1328515bb4b6d89d2e0001e6e49fa12: Waiting for close lock at 1676142212739Disabling compacts and flushes for region at 1676142212739Disabling writes for close at 1676142212739Writing region close event to WAL at 1676142212739Closed at 1676142212739 2023-02-11 19:03:32,740 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d19369f1367219909e3dd22efe0bb708, NAME => 'testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,747 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d19369f1367219909e3dd22efe0bb708, disabling compactions & flushes 2023-02-11 19:03:32,748 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:32,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:32,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. after waiting 0 ms 2023-02-11 19:03:32,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:32,748 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:32,748 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d19369f1367219909e3dd22efe0bb708: Waiting for close lock at 1676142212748Disabling compacts and flushes for region at 1676142212748Disabling writes for close at 1676142212748Writing region close event to WAL at 1676142212748Closed at 1676142212748 2023-02-11 19:03:32,748 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c0ef05186abfbad195663be8d73ab9b0, NAME => 'testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,758 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,758 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c0ef05186abfbad195663be8d73ab9b0, disabling compactions & flushes 2023-02-11 19:03:32,758 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:32,758 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:32,758 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. after waiting 0 ms 2023-02-11 19:03:32,758 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:32,758 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:32,758 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c0ef05186abfbad195663be8d73ab9b0: Waiting for close lock at 1676142212758Disabling compacts and flushes for region at 1676142212758Disabling writes for close at 1676142212758Writing region close event to WAL at 1676142212758Closed at 1676142212758 2023-02-11 19:03:32,759 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => be908093dbb006cd9be0fd4e23662c91, NAME => 'testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing be908093dbb006cd9be0fd4e23662c91, disabling compactions & flushes 2023-02-11 19:03:32,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:32,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:32,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. after waiting 0 ms 2023-02-11 19:03:32,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:32,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:32,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for be908093dbb006cd9be0fd4e23662c91: Waiting for close lock at 1676142212766Disabling compacts and flushes for region at 1676142212766Disabling writes for close at 1676142212766Writing region close event to WAL at 1676142212766Closed at 1676142212766 2023-02-11 19:03:32,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7daa909645d90d5ac028087af882baa, NAME => 'testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.tmp 2023-02-11 19:03:32,778 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:32,778 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c7daa909645d90d5ac028087af882baa, disabling compactions & flushes 2023-02-11 19:03:32,778 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:32,778 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:32,778 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. after waiting 0 ms 2023-02-11 19:03:32,778 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:32,778 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:32,778 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c7daa909645d90d5ac028087af882baa: Waiting for close lock at 1676142212778Disabling compacts and flushes for region at 1676142212778Disabling writes for close at 1676142212778Writing region close event to WAL at 1676142212778Closed at 1676142212778 2023-02-11 19:03:32,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:33,118 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,118 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9759e84fac8e33c759a4af887e07bd34, disabling compactions & flushes 2023-02-11 19:03:33,118 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,118 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,118 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. after waiting 0 ms 2023-02-11 19:03:33,118 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,119 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9759e84fac8e33c759a4af887e07bd34: Waiting for close lock at 1676142213118Disabling compacts and flushes for region at 1676142213118Disabling writes for close at 1676142213118Writing region close event to WAL at 1676142213119 (+1 ms)Closed at 1676142213119 2023-02-11 19:03:33,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 960b83fab17e015bbd62d62dd0c9d132, disabling compactions & flushes 2023-02-11 19:03:33,133 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. after waiting 0 ms 2023-02-11 19:03:33,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,133 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,133 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 960b83fab17e015bbd62d62dd0c9d132: Waiting for close lock at 1676142213133Disabling compacts and flushes for region at 1676142213133Disabling writes for close at 1676142213133Writing region close event to WAL at 1676142213133Closed at 1676142213133 2023-02-11 19:03:33,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:33,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676142212190.0f948dab103d347915da84203011fbdc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142213137"}]},"ts":"1676142213137"} 2023-02-11 19:03:33,142 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 19:03:33,144 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:33,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142213144"}]},"ts":"1676142213144"} 2023-02-11 19:03:33,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 19:03:33,153 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:33,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:33,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:33,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:33,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=de0005f8ed15524083f68c4a7bfdd603, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9759e84fac8e33c759a4af887e07bd34, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0f948dab103d347915da84203011fbdc, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92d401a14d25c8dbf740d2b4625c54ac, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=960b83fab17e015bbd62d62dd0c9d132, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d1328515bb4b6d89d2e0001e6e49fa12, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d19369f1367219909e3dd22efe0bb708, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c0ef05186abfbad195663be8d73ab9b0, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=be908093dbb006cd9be0fd4e23662c91, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7daa909645d90d5ac028087af882baa, ASSIGN}] 2023-02-11 19:03:33,166 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7daa909645d90d5ac028087af882baa, ASSIGN 2023-02-11 19:03:33,166 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=be908093dbb006cd9be0fd4e23662c91, ASSIGN 2023-02-11 19:03:33,167 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c0ef05186abfbad195663be8d73ab9b0, ASSIGN 2023-02-11 19:03:33,167 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d19369f1367219909e3dd22efe0bb708, ASSIGN 2023-02-11 19:03:33,167 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d1328515bb4b6d89d2e0001e6e49fa12, ASSIGN 2023-02-11 19:03:33,167 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c7daa909645d90d5ac028087af882baa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41511,1676142210828; forceNewPlan=false, retain=false 2023-02-11 19:03:33,167 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=be908093dbb006cd9be0fd4e23662c91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44767,1676142210757; forceNewPlan=false, retain=false 2023-02-11 19:03:33,168 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c0ef05186abfbad195663be8d73ab9b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41511,1676142210828; forceNewPlan=false, retain=false 2023-02-11 19:03:33,168 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d19369f1367219909e3dd22efe0bb708, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44767,1676142210757; forceNewPlan=false, retain=false 2023-02-11 19:03:33,168 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d1328515bb4b6d89d2e0001e6e49fa12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41511,1676142210828; forceNewPlan=false, retain=false 2023-02-11 19:03:33,169 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=960b83fab17e015bbd62d62dd0c9d132, ASSIGN 2023-02-11 19:03:33,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92d401a14d25c8dbf740d2b4625c54ac, ASSIGN 2023-02-11 19:03:33,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0f948dab103d347915da84203011fbdc, ASSIGN 2023-02-11 19:03:33,169 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9759e84fac8e33c759a4af887e07bd34, ASSIGN 2023-02-11 19:03:33,170 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=de0005f8ed15524083f68c4a7bfdd603, ASSIGN 2023-02-11 19:03:33,170 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=960b83fab17e015bbd62d62dd0c9d132, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41511,1676142210828; forceNewPlan=false, retain=false 2023-02-11 19:03:33,170 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9759e84fac8e33c759a4af887e07bd34, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44767,1676142210757; forceNewPlan=false, retain=false 2023-02-11 19:03:33,170 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0f948dab103d347915da84203011fbdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41511,1676142210828; forceNewPlan=false, retain=false 2023-02-11 19:03:33,170 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=92d401a14d25c8dbf740d2b4625c54ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44767,1676142210757; forceNewPlan=false, retain=false 2023-02-11 19:03:33,171 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=de0005f8ed15524083f68c4a7bfdd603, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44767,1676142210757; forceNewPlan=false, retain=false 2023-02-11 19:03:33,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:33,318 INFO [jenkins-hbase4:38695] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 19:03:33,321 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d19369f1367219909e3dd22efe0bb708, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,321 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=92d401a14d25c8dbf740d2b4625c54ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,321 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213321"}]},"ts":"1676142213321"} 2023-02-11 19:03:33,321 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=de0005f8ed15524083f68c4a7bfdd603, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9759e84fac8e33c759a4af887e07bd34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=be908093dbb006cd9be0fd4e23662c91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,322 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213321"}]},"ts":"1676142213321"} 2023-02-11 19:03:33,322 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142213321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213321"}]},"ts":"1676142213321"} 2023-02-11 19:03:33,322 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213321"}]},"ts":"1676142213321"} 2023-02-11 19:03:33,322 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213321"}]},"ts":"1676142213321"} 2023-02-11 19:03:33,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure d19369f1367219909e3dd22efe0bb708, server=jenkins-hbase4.apache.org,44767,1676142210757}] 2023-02-11 19:03:33,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 9759e84fac8e33c759a4af887e07bd34, server=jenkins-hbase4.apache.org,44767,1676142210757}] 2023-02-11 19:03:33,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure de0005f8ed15524083f68c4a7bfdd603, server=jenkins-hbase4.apache.org,44767,1676142210757}] 2023-02-11 19:03:33,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 92d401a14d25c8dbf740d2b4625c54ac, server=jenkins-hbase4.apache.org,44767,1676142210757}] 2023-02-11 19:03:33,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure be908093dbb006cd9be0fd4e23662c91, server=jenkins-hbase4.apache.org,44767,1676142210757}] 2023-02-11 19:03:33,332 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c7daa909645d90d5ac028087af882baa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,332 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142213332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213332"}]},"ts":"1676142213332"} 2023-02-11 19:03:33,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d1328515bb4b6d89d2e0001e6e49fa12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,332 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213332"}]},"ts":"1676142213332"} 2023-02-11 19:03:33,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure c7daa909645d90d5ac028087af882baa, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:33,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=960b83fab17e015bbd62d62dd0c9d132, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0f948dab103d347915da84203011fbdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213336"}]},"ts":"1676142213336"} 2023-02-11 19:03:33,336 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676142212190.0f948dab103d347915da84203011fbdc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213336"}]},"ts":"1676142213336"} 2023-02-11 19:03:33,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure d1328515bb4b6d89d2e0001e6e49fa12, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:33,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 960b83fab17e015bbd62d62dd0c9d132, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:33,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 0f948dab103d347915da84203011fbdc, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:33,342 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c0ef05186abfbad195663be8d73ab9b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,343 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142213342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142213342"}]},"ts":"1676142213342"} 2023-02-11 19:03:33,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure c0ef05186abfbad195663be8d73ab9b0, server=jenkins-hbase4.apache.org,41511,1676142210828}] 2023-02-11 19:03:33,478 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,478 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:33,481 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:33,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:33,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92d401a14d25c8dbf740d2b4625c54ac, NAME => 'testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 19:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,486 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,488 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1 2023-02-11 19:03:33,488 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1 2023-02-11 19:03:33,488 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92d401a14d25c8dbf740d2b4625c54ac columnFamilyName f1 2023-02-11 19:03:33,489 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(310): Store=92d401a14d25c8dbf740d2b4625c54ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,489 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,490 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2 2023-02-11 19:03:33,490 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2 2023-02-11 19:03:33,491 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92d401a14d25c8dbf740d2b4625c54ac columnFamilyName f2 2023-02-11 19:03:33,491 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(310): Store=92d401a14d25c8dbf740d2b4625c54ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 960b83fab17e015bbd62d62dd0c9d132, NAME => 'testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 19:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,495 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,496 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1 2023-02-11 19:03:33,496 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1 2023-02-11 19:03:33,497 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 960b83fab17e015bbd62d62dd0c9d132 columnFamilyName f1 2023-02-11 19:03:33,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:33,497 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(310): Store=960b83fab17e015bbd62d62dd0c9d132/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,497 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,500 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2 2023-02-11 19:03:33,500 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2 2023-02-11 19:03:33,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,500 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 960b83fab17e015bbd62d62dd0c9d132 columnFamilyName f2 2023-02-11 19:03:33,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 92d401a14d25c8dbf740d2b4625c54ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69057252, jitterRate=0.029033243656158447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 92d401a14d25c8dbf740d2b4625c54ac: Running coprocessor pre-open hook at 1676142213485Writing region info on filesystem at 1676142213485Initializing all the Stores at 1676142213486 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213486Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213486Cleaning up temporary data from old regions at 1676142213494 (+8 ms)Cleaning up detritus from prior splits at 1676142213494Running coprocessor post-open hooks at 1676142213500 (+6 ms)Region opened successfully at 1676142213500 2023-02-11 19:03:33,500 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(310): Store=960b83fab17e015bbd62d62dd0c9d132/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac., pid=24, masterSystemTime=1676142213477 2023-02-11 19:03:33,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,505 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=92d401a14d25c8dbf740d2b4625c54ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,506 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213505"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213505"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213505"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213505"}]},"ts":"1676142213505"} 2023-02-11 19:03:33,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:33,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:33,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9759e84fac8e33c759a4af887e07bd34, NAME => 'testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 19:03:33,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:33,508 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,510 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1 2023-02-11 19:03:33,510 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1 2023-02-11 19:03:33,510 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9759e84fac8e33c759a4af887e07bd34 columnFamilyName f1 2023-02-11 19:03:33,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-11 19:03:33,511 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(310): Store=9759e84fac8e33c759a4af887e07bd34/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 92d401a14d25c8dbf740d2b4625c54ac, server=jenkins-hbase4.apache.org,44767,1676142210757 in 181 msec 2023-02-11 19:03:33,511 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 960b83fab17e015bbd62d62dd0c9d132; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65221030, jitterRate=-0.028130918741226196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 960b83fab17e015bbd62d62dd0c9d132: Running coprocessor pre-open hook at 1676142213494Writing region info on filesystem at 1676142213494Initializing all the Stores at 1676142213494Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213494Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213494Cleaning up temporary data from old regions at 1676142213504 (+10 ms)Cleaning up detritus from prior splits at 1676142213504Running coprocessor post-open hooks at 1676142213512 (+8 ms)Region opened successfully at 1676142213512 2023-02-11 19:03:33,513 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2 2023-02-11 19:03:33,513 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2 2023-02-11 19:03:33,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=92d401a14d25c8dbf740d2b4625c54ac, ASSIGN in 347 msec 2023-02-11 19:03:33,513 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9759e84fac8e33c759a4af887e07bd34 columnFamilyName f2 2023-02-11 19:03:33,513 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(310): Store=9759e84fac8e33c759a4af887e07bd34/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132., pid=28, masterSystemTime=1676142213490 2023-02-11 19:03:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:33,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:33,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7daa909645d90d5ac028087af882baa, NAME => 'testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 19:03:33,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=960b83fab17e015bbd62d62dd0c9d132, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,516 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213516"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213516"}]},"ts":"1676142213516"} 2023-02-11 19:03:33,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:33,519 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-11 19:03:33,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 960b83fab17e015bbd62d62dd0c9d132, server=jenkins-hbase4.apache.org,41511,1676142210828 in 179 msec 2023-02-11 19:03:33,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=960b83fab17e015bbd62d62dd0c9d132, ASSIGN in 356 msec 2023-02-11 19:03:33,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9759e84fac8e33c759a4af887e07bd34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64645815, jitterRate=-0.036702290177345276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9759e84fac8e33c759a4af887e07bd34: Running coprocessor pre-open hook at 1676142213507Writing region info on filesystem at 1676142213507Initializing all the Stores at 1676142213508 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213508Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213508Cleaning up temporary data from old regions at 1676142213516 (+8 ms)Cleaning up detritus from prior splits at 1676142213516Running coprocessor post-open hooks at 1676142213521 (+5 ms)Region opened successfully at 1676142213521 2023-02-11 19:03:33,521 DEBUG [StoreOpener-c7daa909645d90d5ac028087af882baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/f1 2023-02-11 19:03:33,522 DEBUG [StoreOpener-c7daa909645d90d5ac028087af882baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/f1 2023-02-11 19:03:33,522 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7daa909645d90d5ac028087af882baa columnFamilyName f1 2023-02-11 19:03:33,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34., pid=22, masterSystemTime=1676142213477 2023-02-11 19:03:33,522 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(310): Store=c7daa909645d90d5ac028087af882baa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,523 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:33,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:33,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de0005f8ed15524083f68c4a7bfdd603, NAME => 'testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 19:03:33,524 DEBUG [StoreOpener-c7daa909645d90d5ac028087af882baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/f2 2023-02-11 19:03:33,524 DEBUG [StoreOpener-c7daa909645d90d5ac028087af882baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/f2 2023-02-11 19:03:33,524 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9759e84fac8e33c759a4af887e07bd34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,525 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213524"}]},"ts":"1676142213524"} 2023-02-11 19:03:33,525 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7daa909645d90d5ac028087af882baa columnFamilyName f2 2023-02-11 19:03:33,525 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(310): Store=c7daa909645d90d5ac028087af882baa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,527 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,528 DEBUG [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/f1 2023-02-11 19:03:33,528 DEBUG [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/f1 2023-02-11 19:03:33,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,529 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de0005f8ed15524083f68c4a7bfdd603 columnFamilyName f1 2023-02-11 19:03:33,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-11 19:03:33,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 9759e84fac8e33c759a4af887e07bd34, server=jenkins-hbase4.apache.org,44767,1676142210757 in 202 msec 2023-02-11 19:03:33,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:33,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9759e84fac8e33c759a4af887e07bd34, ASSIGN in 365 msec 2023-02-11 19:03:33,531 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(310): Store=de0005f8ed15524083f68c4a7bfdd603/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,531 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,532 DEBUG [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/f2 2023-02-11 19:03:33,532 DEBUG [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/f2 2023-02-11 19:03:33,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7daa909645d90d5ac028087af882baa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65566219, jitterRate=-0.022987201809883118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,533 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de0005f8ed15524083f68c4a7bfdd603 columnFamilyName f2 2023-02-11 19:03:33,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7daa909645d90d5ac028087af882baa: Running coprocessor pre-open hook at 1676142213516Writing region info on filesystem at 1676142213516Initializing all the Stores at 1676142213518 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213518Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213519 (+1 ms)Cleaning up temporary data from old regions at 1676142213527 (+8 ms)Cleaning up detritus from prior splits at 1676142213528 (+1 ms)Running coprocessor post-open hooks at 1676142213533 (+5 ms)Region opened successfully at 1676142213533 2023-02-11 19:03:33,533 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(310): Store=de0005f8ed15524083f68c4a7bfdd603/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa., pid=26, masterSystemTime=1676142213490 2023-02-11 19:03:33,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:33,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:33,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:33,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1328515bb4b6d89d2e0001e6e49fa12, NAME => 'testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 19:03:33,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c7daa909645d90d5ac028087af882baa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,536 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142213535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213535"}]},"ts":"1676142213535"} 2023-02-11 19:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,537 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,539 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1 2023-02-11 19:03:33,539 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1 2023-02-11 19:03:33,539 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1328515bb4b6d89d2e0001e6e49fa12 columnFamilyName f1 2023-02-11 19:03:33,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:33,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-11 19:03:33,540 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(310): Store=d1328515bb4b6d89d2e0001e6e49fa12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure c7daa909645d90d5ac028087af882baa, server=jenkins-hbase4.apache.org,41511,1676142210828 in 204 msec 2023-02-11 19:03:33,540 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c7daa909645d90d5ac028087af882baa, ASSIGN in 376 msec 2023-02-11 19:03:33,541 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2 2023-02-11 19:03:33,541 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2 2023-02-11 19:03:33,542 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1328515bb4b6d89d2e0001e6e49fa12 columnFamilyName f2 2023-02-11 19:03:33,542 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(310): Store=d1328515bb4b6d89d2e0001e6e49fa12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened de0005f8ed15524083f68c4a7bfdd603; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69320476, jitterRate=0.0329555869102478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for de0005f8ed15524083f68c4a7bfdd603: Running coprocessor pre-open hook at 1676142213526Writing region info on filesystem at 1676142213526Initializing all the Stores at 1676142213527 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213527Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213527Cleaning up temporary data from old regions at 1676142213535 (+8 ms)Cleaning up detritus from prior splits at 1676142213537 (+2 ms)Running coprocessor post-open hooks at 1676142213543 (+6 ms)Region opened successfully at 1676142213543 2023-02-11 19:03:33,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603., pid=23, masterSystemTime=1676142213477 2023-02-11 19:03:33,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:33,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:33,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:33,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => be908093dbb006cd9be0fd4e23662c91, NAME => 'testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 19:03:33,546 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=de0005f8ed15524083f68c4a7bfdd603, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,546 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676142213546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213546"}]},"ts":"1676142213546"} 2023-02-11 19:03:33,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,548 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:33,550 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1 2023-02-11 19:03:33,550 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1 2023-02-11 19:03:33,550 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be908093dbb006cd9be0fd4e23662c91 columnFamilyName f1 2023-02-11 19:03:33,551 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(310): Store=be908093dbb006cd9be0fd4e23662c91/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,551 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-11 19:03:33,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure de0005f8ed15524083f68c4a7bfdd603, server=jenkins-hbase4.apache.org,44767,1676142210757 in 223 msec 2023-02-11 19:03:33,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,553 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2 2023-02-11 19:03:33,553 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2 2023-02-11 19:03:33,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d1328515bb4b6d89d2e0001e6e49fa12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61097334, jitterRate=-0.089578777551651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d1328515bb4b6d89d2e0001e6e49fa12: Running coprocessor pre-open hook at 1676142213536Writing region info on filesystem at 1676142213536Initializing all the Stores at 1676142213537 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213537Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213537Cleaning up temporary data from old regions at 1676142213545 (+8 ms)Cleaning up detritus from prior splits at 1676142213545Running coprocessor post-open hooks at 1676142213553 (+8 ms)Region opened successfully at 1676142213553 2023-02-11 19:03:33,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=de0005f8ed15524083f68c4a7bfdd603, ASSIGN in 388 msec 2023-02-11 19:03:33,554 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be908093dbb006cd9be0fd4e23662c91 columnFamilyName f2 2023-02-11 19:03:33,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12., pid=27, masterSystemTime=1676142213490 2023-02-11 19:03:33,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:33,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:33,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:33,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0f948dab103d347915da84203011fbdc, NAME => 'testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 19:03:33,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d1328515bb4b6d89d2e0001e6e49fa12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213556"}]},"ts":"1676142213556"} 2023-02-11 19:03:33,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,558 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(310): Store=be908093dbb006cd9be0fd4e23662c91/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,562 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-11 19:03:33,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure d1328515bb4b6d89d2e0001e6e49fa12, server=jenkins-hbase4.apache.org,41511,1676142210828 in 224 msec 2023-02-11 19:03:33,564 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1 2023-02-11 19:03:33,564 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1 2023-02-11 19:03:33,565 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f948dab103d347915da84203011fbdc columnFamilyName f1 2023-02-11 19:03:33,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d1328515bb4b6d89d2e0001e6e49fa12, ASSIGN in 399 msec 2023-02-11 19:03:33,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,565 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(310): Store=0f948dab103d347915da84203011fbdc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,565 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,567 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2 2023-02-11 19:03:33,567 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2 2023-02-11 19:03:33,567 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f948dab103d347915da84203011fbdc columnFamilyName f2 2023-02-11 19:03:33,568 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(310): Store=0f948dab103d347915da84203011fbdc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:33,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened be908093dbb006cd9be0fd4e23662c91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67508714, jitterRate=0.005958229303359985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:33,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for be908093dbb006cd9be0fd4e23662c91: Running coprocessor pre-open hook at 1676142213547Writing region info on filesystem at 1676142213547Initializing all the Stores at 1676142213548 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213548Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213548Cleaning up temporary data from old regions at 1676142213564 (+16 ms)Cleaning up detritus from prior splits at 1676142213564Running coprocessor post-open hooks at 1676142213573 (+9 ms)Region opened successfully at 1676142213573 2023-02-11 19:03:33,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91., pid=25, masterSystemTime=1676142213477 2023-02-11 19:03:33,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0f948dab103d347915da84203011fbdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68163762, jitterRate=0.015719205141067505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0f948dab103d347915da84203011fbdc: Running coprocessor pre-open hook at 1676142213557Writing region info on filesystem at 1676142213557Initializing all the Stores at 1676142213562 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213562Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213562Cleaning up temporary data from old regions at 1676142213570 (+8 ms)Cleaning up detritus from prior splits at 1676142213570Running coprocessor post-open hooks at 1676142213576 (+6 ms)Region opened successfully at 1676142213576 2023-02-11 19:03:33,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:33,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:33,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:33,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d19369f1367219909e3dd22efe0bb708, NAME => 'testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 19:03:33,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=be908093dbb006cd9be0fd4e23662c91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc., pid=29, masterSystemTime=1676142213490 2023-02-11 19:03:33,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213577"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213577"}]},"ts":"1676142213577"} 2023-02-11 19:03:33,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:33,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:33,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:33,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c0ef05186abfbad195663be8d73ab9b0, NAME => 'testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 19:03:33,580 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:33,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,581 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1 2023-02-11 19:03:33,581 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,581 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1 2023-02-11 19:03:33,582 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19369f1367219909e3dd22efe0bb708 columnFamilyName f1 2023-02-11 19:03:33,582 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(310): Store=d19369f1367219909e3dd22efe0bb708/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,583 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1 2023-02-11 19:03:33,583 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1 2023-02-11 19:03:33,583 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0ef05186abfbad195663be8d73ab9b0 columnFamilyName f1 2023-02-11 19:03:33,583 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,583 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(310): Store=c0ef05186abfbad195663be8d73ab9b0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0f948dab103d347915da84203011fbdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,584 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-11 19:03:33,584 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676142212190.0f948dab103d347915da84203011fbdc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213582"}]},"ts":"1676142213582"} 2023-02-11 19:03:33,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure be908093dbb006cd9be0fd4e23662c91, server=jenkins-hbase4.apache.org,44767,1676142210757 in 248 msec 2023-02-11 19:03:33,585 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2 2023-02-11 19:03:33,585 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2 2023-02-11 19:03:33,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=be908093dbb006cd9be0fd4e23662c91, ASSIGN in 420 msec 2023-02-11 19:03:33,586 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19369f1367219909e3dd22efe0bb708 columnFamilyName f2 2023-02-11 19:03:33,586 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2 2023-02-11 19:03:33,586 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2 2023-02-11 19:03:33,586 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0ef05186abfbad195663be8d73ab9b0 columnFamilyName f2 2023-02-11 19:03:33,586 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(310): Store=d19369f1367219909e3dd22efe0bb708/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,587 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(310): Store=c0ef05186abfbad195663be8d73ab9b0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:33,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-11 19:03:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:33,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 0f948dab103d347915da84203011fbdc, server=jenkins-hbase4.apache.org,41511,1676142210828 in 247 msec 2023-02-11 19:03:33,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0f948dab103d347915da84203011fbdc, ASSIGN in 426 msec 2023-02-11 19:03:33,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:33,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:33,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d19369f1367219909e3dd22efe0bb708; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58961768, jitterRate=-0.12140119075775146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d19369f1367219909e3dd22efe0bb708: Running coprocessor pre-open hook at 1676142213578Writing region info on filesystem at 1676142213578Initializing all the Stores at 1676142213579 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213579Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213579Cleaning up temporary data from old regions at 1676142213588 (+9 ms)Cleaning up detritus from prior splits at 1676142213589 (+1 ms)Running coprocessor post-open hooks at 1676142213595 (+6 ms)Region opened successfully at 1676142213595 2023-02-11 19:03:33,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:33,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708., pid=21, masterSystemTime=1676142213477 2023-02-11 19:03:33,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c0ef05186abfbad195663be8d73ab9b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65975974, jitterRate=-0.01688137650489807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:33,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c0ef05186abfbad195663be8d73ab9b0: Running coprocessor pre-open hook at 1676142213580Writing region info on filesystem at 1676142213580Initializing all the Stores at 1676142213581 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213581Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142213581Cleaning up temporary data from old regions at 1676142213589 (+8 ms)Cleaning up detritus from prior splits at 1676142213589Running coprocessor post-open hooks at 1676142213596 (+7 ms)Region opened successfully at 1676142213596 2023-02-11 19:03:33,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0., pid=30, masterSystemTime=1676142213490 2023-02-11 19:03:33,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:33,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:33,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d19369f1367219909e3dd22efe0bb708, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:33,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213598"}]},"ts":"1676142213598"} 2023-02-11 19:03:33,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:33,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:33,599 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=c0ef05186abfbad195663be8d73ab9b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:33,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676142213599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142213599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142213599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142213599"}]},"ts":"1676142213599"} 2023-02-11 19:03:33,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-11 19:03:33,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure d19369f1367219909e3dd22efe0bb708, server=jenkins-hbase4.apache.org,44767,1676142210757 in 276 msec 2023-02-11 19:03:33,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-11 19:03:33,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d19369f1367219909e3dd22efe0bb708, ASSIGN in 438 msec 2023-02-11 19:03:33,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure c0ef05186abfbad195663be8d73ab9b0, server=jenkins-hbase4.apache.org,41511,1676142210828 in 256 msec 2023-02-11 19:03:33,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-11 19:03:33,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c0ef05186abfbad195663be8d73ab9b0, ASSIGN in 439 msec 2023-02-11 19:03:33,605 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:33,605 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142213605"}]},"ts":"1676142213605"} 2023-02-11 19:03:33,607 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 19:03:33,609 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:33,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.4190 sec 2023-02-11 19:03:33,657 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:03:34,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:34,302 INFO [Listener at localhost/34971] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 19:03:34,303 DEBUG [Listener at localhost/34971] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 19:03:34,303 INFO [Listener at localhost/34971] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:34,307 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 19:03:34,307 INFO [Listener at localhost/34971] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:34,307 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 19:03:34,307 INFO [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:03:34,360 DEBUG [hconnection-0x216de13d-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:34,381 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:34,391 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44767] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:34,392 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41511] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:34,536 INFO [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:03:34,536 INFO [Listener at localhost/34971] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:03:34,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:03:34,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142214538 (current time:1676142214538). 2023-02-11 19:03:34,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:03:34,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] zookeeper.ReadOnlyZKClient(139): Connect 0x7e0d024b to 127.0.0.1:53493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:34,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35ac326e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:34,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:34,549 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:34,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e0d024b to 127.0.0.1:53493 2023-02-11 19:03:34,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:34,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:03:34,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:03:34,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:03:34,555 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:03:34,556 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676142814556 2023-02-11 19:03:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:03:34,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 19:03:34,557 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:34,557 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:03:34,558 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:03:34,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:03:34,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-11 19:03:34,559 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:03:34,560 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676142814560 2023-02-11 19:03:34,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,578 INFO [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-11 19:03:34,578 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:34,579 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-11 19:03:34,579 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-11 19:03:34,653 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,653 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,655 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:34,655 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:34,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:34,655 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:34,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:34,655 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,655 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,656 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,656 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 19:03:34,656 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 19:03:34,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,657 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-11 19:03:34,657 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:34,657 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-11 19:03:34,658 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:34,658 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-11 19:03:34,658 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:34,658 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-11 19:03:34,658 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44767,1676142210757' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-11 19:03:34,658 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-11 19:03:34,659 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-11 19:03:34,659 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41511,1676142210828' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-11 19:03:34,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:34,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:34,660 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:03:34,661 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,661 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:34,662 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,662 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,662 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:34,662 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:34,663 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,663 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44767,1676142210757' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13230a0f[Count = 1] remaining members to acquire global barrier 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:34,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41511,1676142210828' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-11 19:03:34,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13230a0f[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:34,666 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-11 19:03:34,666 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,668 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:34,668 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:34,668 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:34,668 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:34,668 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:34,668 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. started... 2023-02-11 19:03:34,669 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:34,668 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. started... 2023-02-11 19:03:34,669 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. started... 2023-02-11 19:03:34,672 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 19:03:34,672 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:34,672 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:34,672 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 960b83fab17e015bbd62d62dd0c9d132 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:34,672 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9759e84fac8e33c759a4af887e07bd34 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 19:03:34,672 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. started... 2023-02-11 19:03:34,673 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c7daa909645d90d5ac028087af882baa: 2023-02-11 19:03:34,673 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:34,674 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d1328515bb4b6d89d2e0001e6e49fa12 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:34,674 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. started... 2023-02-11 19:03:34,673 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,675 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,675 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:34,675 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:34,673 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 19:03:34,673 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:34,675 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:34,675 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:34,675 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 92d401a14d25c8dbf740d2b4625c54ac 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:34,675 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:34,676 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. started... 2023-02-11 19:03:34,677 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HRegion(2744): Flushing be908093dbb006cd9be0fd4e23662c91 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 19:03:34,735 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. completed. 2023-02-11 19:03:34,735 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:34,735 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 19:03:34,735 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. started... 2023-02-11 19:03:34,737 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c0ef05186abfbad195663be8d73ab9b0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:34,739 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f1/e0eaf8c4582b43358d100d2b17fde927 2023-02-11 19:03:34,740 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f1/faa8f0610ea0444b9f8bbf03326975f3 2023-02-11 19:03:34,753 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f1/52f46bfa018b4ab5b7dd7b9a9e1bcd95 2023-02-11 19:03:34,760 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f1/1f911c6d3426452691a3cdce39c13688 2023-02-11 19:03:34,775 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f1/edbf51b512e245829d6e9ae0dfe7bfc4 2023-02-11 19:03:34,818 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f2/584718eded8b43f498e2ce09debd3891 2023-02-11 19:03:34,818 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f1/418e9190f52444e6af5dbf2b0beb3a36 2023-02-11 19:03:34,825 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f1/52f46bfa018b4ab5b7dd7b9a9e1bcd95 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/52f46bfa018b4ab5b7dd7b9a9e1bcd95 2023-02-11 19:03:34,832 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f2/e4ffc449fa3748e6bfd8dd97ac77afd0 2023-02-11 19:03:34,836 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/52f46bfa018b4ab5b7dd7b9a9e1bcd95, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,837 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f2/9c02f8bc1ee24e9db63ca4a3dd3d235e 2023-02-11 19:03:34,837 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f2/584718eded8b43f498e2ce09debd3891 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/584718eded8b43f498e2ce09debd3891 2023-02-11 19:03:34,841 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f2/f99c2bad4adf40a18849f2d17fca4d2c 2023-02-11 19:03:34,843 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f1/e0eaf8c4582b43358d100d2b17fde927 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/e0eaf8c4582b43358d100d2b17fde927 2023-02-11 19:03:34,847 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/584718eded8b43f498e2ce09debd3891, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,849 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 960b83fab17e015bbd62d62dd0c9d132 in 177ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:34,849 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 19:03:34,849 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 960b83fab17e015bbd62d62dd0c9d132: 2023-02-11 19:03:34,850 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,850 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,850 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/52f46bfa018b4ab5b7dd7b9a9e1bcd95] hfiles 2023-02-11 19:03:34,850 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/52f46bfa018b4ab5b7dd7b9a9e1bcd95 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,850 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/584718eded8b43f498e2ce09debd3891] hfiles 2023-02-11 19:03:34,850 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/584718eded8b43f498e2ce09debd3891 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,851 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f1/edbf51b512e245829d6e9ae0dfe7bfc4 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/edbf51b512e245829d6e9ae0dfe7bfc4 2023-02-11 19:03:34,854 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/e0eaf8c4582b43358d100d2b17fde927, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:34,855 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f2/e4ffc449fa3748e6bfd8dd97ac77afd0 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/e4ffc449fa3748e6bfd8dd97ac77afd0 2023-02-11 19:03:34,860 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:34,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:34,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:34,862 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:03:34,870 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f1/faa8f0610ea0444b9f8bbf03326975f3 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/faa8f0610ea0444b9f8bbf03326975f3 2023-02-11 19:03:34,875 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/faa8f0610ea0444b9f8bbf03326975f3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:34,876 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f2/4bc3b4c90b644d3db95946f1a5b5f7aa 2023-02-11 19:03:34,877 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f2/9c02f8bc1ee24e9db63ca4a3dd3d235e as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/9c02f8bc1ee24e9db63ca4a3dd3d235e 2023-02-11 19:03:34,881 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/edbf51b512e245829d6e9ae0dfe7bfc4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,881 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/e4ffc449fa3748e6bfd8dd97ac77afd0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:34,882 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 9759e84fac8e33c759a4af887e07bd34 in 210ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:34,883 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f2/f99c2bad4adf40a18849f2d17fca4d2c as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/f99c2bad4adf40a18849f2d17fca4d2c 2023-02-11 19:03:34,885 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/9c02f8bc1ee24e9db63ca4a3dd3d235e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:34,886 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for be908093dbb006cd9be0fd4e23662c91 in 209ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for be908093dbb006cd9be0fd4e23662c91: 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9759e84fac8e33c759a4af887e07bd34: 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/faa8f0610ea0444b9f8bbf03326975f3] hfiles 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/faa8f0610ea0444b9f8bbf03326975f3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,893 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/9c02f8bc1ee24e9db63ca4a3dd3d235e] hfiles 2023-02-11 19:03:34,894 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/e0eaf8c4582b43358d100d2b17fde927] hfiles 2023-02-11 19:03:34,894 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/e0eaf8c4582b43358d100d2b17fde927 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,894 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/e4ffc449fa3748e6bfd8dd97ac77afd0] hfiles 2023-02-11 19:03:34,894 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/e4ffc449fa3748e6bfd8dd97ac77afd0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,894 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/9c02f8bc1ee24e9db63ca4a3dd3d235e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,896 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f1/1f911c6d3426452691a3cdce39c13688 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/1f911c6d3426452691a3cdce39c13688 2023-02-11 19:03:34,897 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/f99c2bad4adf40a18849f2d17fca4d2c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,898 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 92d401a14d25c8dbf740d2b4625c54ac in 223ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:34,898 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 92d401a14d25c8dbf740d2b4625c54ac: 2023-02-11 19:03:34,898 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,898 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,899 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/edbf51b512e245829d6e9ae0dfe7bfc4] hfiles 2023-02-11 19:03:34,899 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/edbf51b512e245829d6e9ae0dfe7bfc4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,899 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/f99c2bad4adf40a18849f2d17fca4d2c] hfiles 2023-02-11 19:03:34,899 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/f99c2bad4adf40a18849f2d17fca4d2c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,903 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/1f911c6d3426452691a3cdce39c13688, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,904 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f2/4bc3b4c90b644d3db95946f1a5b5f7aa as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/4bc3b4c90b644d3db95946f1a5b5f7aa 2023-02-11 19:03:34,913 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/4bc3b4c90b644d3db95946f1a5b5f7aa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,914 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d1328515bb4b6d89d2e0001e6e49fa12 in 240ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d1328515bb4b6d89d2e0001e6e49fa12: 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/1f911c6d3426452691a3cdce39c13688] hfiles 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/1f911c6d3426452691a3cdce39c13688 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/4bc3b4c90b644d3db95946f1a5b5f7aa] hfiles 2023-02-11 19:03:34,914 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/4bc3b4c90b644d3db95946f1a5b5f7aa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,916 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f2/efb9cbe388fe4b61a1169a28d7199b42 2023-02-11 19:03:34,923 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. completed. 2023-02-11 19:03:34,923 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:34,923 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:34,923 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. started... 2023-02-11 19:03:34,923 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0f948dab103d347915da84203011fbdc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:34,923 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 19:03:34,927 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f1/418e9190f52444e6af5dbf2b0beb3a36 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/418e9190f52444e6af5dbf2b0beb3a36 2023-02-11 19:03:34,935 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. completed. 2023-02-11 19:03:34,935 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:34,935 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:34,935 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. started... 2023-02-11 19:03:34,935 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 19:03:34,935 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d19369f1367219909e3dd22efe0bb708 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. completed. 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:34,941 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. started... 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for de0005f8ed15524083f68c4a7bfdd603: 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:34,941 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:34,945 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/418e9190f52444e6af5dbf2b0beb3a36, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,945 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f2/efb9cbe388fe4b61a1169a28d7199b42 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/efb9cbe388fe4b61a1169a28d7199b42 2023-02-11 19:03:34,948 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. completed. 2023-02-11 19:03:34,948 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:34,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. completed. 2023-02-11 19:03:34,953 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:34,953 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 19:03:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 19:03:34,962 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/efb9cbe388fe4b61a1169a28d7199b42, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:34,963 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c0ef05186abfbad195663be8d73ab9b0 in 226ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c0ef05186abfbad195663be8d73ab9b0: 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/418e9190f52444e6af5dbf2b0beb3a36] hfiles 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/418e9190f52444e6af5dbf2b0beb3a36 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/efb9cbe388fe4b61a1169a28d7199b42] hfiles 2023-02-11 19:03:34,964 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/efb9cbe388fe4b61a1169a28d7199b42 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:34,976 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f1/a4802df525254e5ca1c17fe4872963c2 2023-02-11 19:03:34,991 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. completed. 2023-02-11 19:03:34,991 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:34,991 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 19:03:35,002 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f2/b9e90d8cc59d47ed9c76ae24e928cbdc 2023-02-11 19:03:35,007 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f1/a4802df525254e5ca1c17fe4872963c2 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/a4802df525254e5ca1c17fe4872963c2 2023-02-11 19:03:35,012 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/a4802df525254e5ca1c17fe4872963c2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:35,013 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f2/b9e90d8cc59d47ed9c76ae24e928cbdc as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/b9e90d8cc59d47ed9c76ae24e928cbdc 2023-02-11 19:03:35,018 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/b9e90d8cc59d47ed9c76ae24e928cbdc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:35,018 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0f948dab103d347915da84203011fbdc in 95ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0f948dab103d347915da84203011fbdc: 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/a4802df525254e5ca1c17fe4872963c2] hfiles 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/a4802df525254e5ca1c17fe4872963c2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/b9e90d8cc59d47ed9c76ae24e928cbdc] hfiles 2023-02-11 19:03:35,019 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/b9e90d8cc59d47ed9c76ae24e928cbdc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,232 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:35,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:35,237 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. completed. 2023-02-11 19:03:35,237 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:35,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:35,237 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 19:03:35,237 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 19:03:35,392 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f1/42959f4102884fe8b0901a74adca2e57 2023-02-11 19:03:35,396 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. completed. 2023-02-11 19:03:35,396 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:35,396 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 19:03:35,396 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 19:03:35,396 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,396 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-11 19:03:35,396 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,41511,1676142210828' in zk 2023-02-11 19:03:35,398 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-11 19:03:35,398 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,398 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:35,398 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-11 19:03:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,41511,1676142210828': 2023-02-11 19:03:35,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41511,1676142210828' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 19:03:35,409 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f2/19f26747615f403aa7d74143ac402a63 2023-02-11 19:03:35,414 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f1/42959f4102884fe8b0901a74adca2e57 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/42959f4102884fe8b0901a74adca2e57 2023-02-11 19:03:35,418 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/42959f4102884fe8b0901a74adca2e57, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:35,420 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f2/19f26747615f403aa7d74143ac402a63 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/19f26747615f403aa7d74143ac402a63 2023-02-11 19:03:35,425 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/19f26747615f403aa7d74143ac402a63, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:35,426 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d19369f1367219909e3dd22efe0bb708 in 491ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d19369f1367219909e3dd22efe0bb708: 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/42959f4102884fe8b0901a74adca2e57] hfiles 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/42959f4102884fe8b0901a74adca2e57 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/19f26747615f403aa7d74143ac402a63] hfiles 2023-02-11 19:03:35,427 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/19f26747615f403aa7d74143ac402a63 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,433 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. completed. 2023-02-11 19:03:35,433 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:35,433 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 19:03:35,433 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 19:03:35,433 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,434 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-11 19:03:35,434 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,44767,1676142210757' in zk 2023-02-11 19:03:35,439 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-11 19:03:35,439 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,439 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:35,439 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-11 19:03:35,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:35,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:35,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:35,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:35,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,44767,1676142210757': 2023-02-11 19:03:35,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44767,1676142210757' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 19:03:35,443 INFO [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-11 19:03:35,443 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:35,443 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:35,443 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,444 INFO [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:03:35,445 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,445 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,445 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:35,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,445 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:35,446 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:35,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:35,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:35,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,447 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,447 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:35,449 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,449 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:35,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:35,455 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:35,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:35,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:35,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,455 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:35,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:35,457 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,457 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:35,457 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,457 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-11 19:03:35,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,527 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:35,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676142214556Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676142215456 (+900 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676142215457 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676142215468 (+11 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676142215485 (+17 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676142215527 (+42 ms) 2023-02-11 19:03:35,529 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:03:35,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 972 msec 2023-02-11 19:03:35,738 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:35,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:03:35,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:03:35,740 INFO [Listener at localhost/34971] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:03:35,745 INFO [Listener at localhost/34971] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:03:35,753 INFO [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:03:35,799 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41511] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:35,827 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44767] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:35,922 INFO [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:03:35,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:03:35,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 19:03:35,934 INFO [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 19:03:35,934 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:35,935 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 19:03:35,935 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 19:03:35,936 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:35,936 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:35,939 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:35,939 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:35,939 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:35,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:35,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:35,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:35,939 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:35,939 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:35,940 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 19:03:35,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 19:03:35,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 19:03:35,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 19:03:35,947 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 19:03:35,947 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 19:03:35,947 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:35,947 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:35,948 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 19:03:35,949 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. started... 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. started... 2023-02-11 19:03:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 19:03:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:35,952 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9759e84fac8e33c759a4af887e07bd34 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. started... 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c7daa909645d90d5ac028087af882baa: 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. started... 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 19:03:35,953 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 960b83fab17e015bbd62d62dd0c9d132 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. started... 2023-02-11 19:03:35,952 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 92d401a14d25c8dbf740d2b4625c54ac 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:35,953 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing be908093dbb006cd9be0fd4e23662c91 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 19:03:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. started... 2023-02-11 19:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:35,953 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 19:03:35,953 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d1328515bb4b6d89d2e0001e6e49fa12 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. started... 2023-02-11 19:03:35,953 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c0ef05186abfbad195663be8d73ab9b0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:36,012 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f1/3712d1053422481582141138f482f64b 2023-02-11 19:03:36,012 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f1/a971df8cb29b47148208038a286500cf 2023-02-11 19:03:36,019 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f1/76476c3da3034bb0b5990149af5bce68 2023-02-11 19:03:36,021 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f1/e92290e168944cdc8b6477b1fc5c4da7 2023-02-11 19:03:36,025 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f1/4822338439c84ebbaac789f24510fb1b 2023-02-11 19:03:36,056 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f2/65b239624edf438d86c67a8bbd38835e 2023-02-11 19:03:36,063 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f1/a971df8cb29b47148208038a286500cf as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/a971df8cb29b47148208038a286500cf 2023-02-11 19:03:36,068 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f2/ce9fe88f5409494589b6d03e8bee3c7b 2023-02-11 19:03:36,069 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/a971df8cb29b47148208038a286500cf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,071 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/.tmp/f2/65b239624edf438d86c67a8bbd38835e as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/65b239624edf438d86c67a8bbd38835e 2023-02-11 19:03:36,075 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f1/3712d1053422481582141138f482f64b as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/3712d1053422481582141138f482f64b 2023-02-11 19:03:36,079 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/65b239624edf438d86c67a8bbd38835e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,080 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 92d401a14d25c8dbf740d2b4625c54ac in 127ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,080 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 92d401a14d25c8dbf740d2b4625c54ac: 2023-02-11 19:03:36,080 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:36,080 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,080 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. started... 2023-02-11 19:03:36,081 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d19369f1367219909e3dd22efe0bb708 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:36,081 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 19:03:36,082 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/3712d1053422481582141138f482f64b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:36,086 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/.tmp/f2/ce9fe88f5409494589b6d03e8bee3c7b as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/ce9fe88f5409494589b6d03e8bee3c7b 2023-02-11 19:03:36,088 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f2/34ff8c9b5c754199a352ec8df8141928 2023-02-11 19:03:36,089 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f2/52b95dc82ed8477a8646d8fd75a206e6 2023-02-11 19:03:36,094 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/ce9fe88f5409494589b6d03e8bee3c7b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:36,095 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 9759e84fac8e33c759a4af887e07bd34 in 143ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,095 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9759e84fac8e33c759a4af887e07bd34: 2023-02-11 19:03:36,095 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f1/e92290e168944cdc8b6477b1fc5c4da7 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/e92290e168944cdc8b6477b1fc5c4da7 2023-02-11 19:03:36,095 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:36,096 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 19:03:36,096 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f1/76476c3da3034bb0b5990149af5bce68 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/76476c3da3034bb0b5990149af5bce68 2023-02-11 19:03:36,096 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,096 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. started... 2023-02-11 19:03:36,096 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de0005f8ed15524083f68c4a7bfdd603: 2023-02-11 19:03:36,096 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,096 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 19:03:36,102 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/e92290e168944cdc8b6477b1fc5c4da7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,102 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/76476c3da3034bb0b5990149af5bce68, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,104 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f1/6823b882ab7e4ae8bc1bd0229516fd9a 2023-02-11 19:03:36,104 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/.tmp/f2/52b95dc82ed8477a8646d8fd75a206e6 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/52b95dc82ed8477a8646d8fd75a206e6 2023-02-11 19:03:36,104 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/.tmp/f2/34ff8c9b5c754199a352ec8df8141928 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/34ff8c9b5c754199a352ec8df8141928 2023-02-11 19:03:36,110 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/52b95dc82ed8477a8646d8fd75a206e6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,111 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c0ef05186abfbad195663be8d73ab9b0 in 158ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,111 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c0ef05186abfbad195663be8d73ab9b0: 2023-02-11 19:03:36,111 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:36,111 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,111 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 19:03:36,112 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. started... 2023-02-11 19:03:36,112 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0f948dab103d347915da84203011fbdc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:36,114 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/34ff8c9b5c754199a352ec8df8141928, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,114 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d1328515bb4b6d89d2e0001e6e49fa12 in 161ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,115 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d1328515bb4b6d89d2e0001e6e49fa12: 2023-02-11 19:03:36,115 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:36,115 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 19:03:36,128 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f2/835f93e7a990472fa99880776dc7c1cc 2023-02-11 19:03:36,136 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f1/ce374c058be0450fbe35722ddb5cd37c 2023-02-11 19:03:36,139 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f1/6823b882ab7e4ae8bc1bd0229516fd9a as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/6823b882ab7e4ae8bc1bd0229516fd9a 2023-02-11 19:03:36,144 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/6823b882ab7e4ae8bc1bd0229516fd9a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,145 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/.tmp/f2/835f93e7a990472fa99880776dc7c1cc as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/835f93e7a990472fa99880776dc7c1cc 2023-02-11 19:03:36,150 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/835f93e7a990472fa99880776dc7c1cc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,151 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d19369f1367219909e3dd22efe0bb708 in 70ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,151 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d19369f1367219909e3dd22efe0bb708: 2023-02-11 19:03:36,151 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,151 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 19:03:36,154 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f2/a205c708308a4859a797b4e7e1f6427e 2023-02-11 19:03:36,160 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f1/ce374c058be0450fbe35722ddb5cd37c as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/ce374c058be0450fbe35722ddb5cd37c 2023-02-11 19:03:36,164 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/ce374c058be0450fbe35722ddb5cd37c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,165 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/.tmp/f2/a205c708308a4859a797b4e7e1f6427e as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/a205c708308a4859a797b4e7e1f6427e 2023-02-11 19:03:36,169 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/a205c708308a4859a797b4e7e1f6427e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,170 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0f948dab103d347915da84203011fbdc in 58ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,170 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0f948dab103d347915da84203011fbdc: 2023-02-11 19:03:36,170 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,170 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 19:03:36,420 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f1/0c1a9ffa35fd4509bbbc1aecf2a992bc 2023-02-11 19:03:36,432 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f2/dfe2c3d71cf5459ba5821581bd5c21eb 2023-02-11 19:03:36,438 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f1/0c1a9ffa35fd4509bbbc1aecf2a992bc as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/0c1a9ffa35fd4509bbbc1aecf2a992bc 2023-02-11 19:03:36,442 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/0c1a9ffa35fd4509bbbc1aecf2a992bc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:36,443 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/.tmp/f2/dfe2c3d71cf5459ba5821581bd5c21eb as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/dfe2c3d71cf5459ba5821581bd5c21eb 2023-02-11 19:03:36,448 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/dfe2c3d71cf5459ba5821581bd5c21eb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:36,449 INFO [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for be908093dbb006cd9be0fd4e23662c91 in 496ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,449 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for be908093dbb006cd9be0fd4e23662c91: 2023-02-11 19:03:36,449 DEBUG [rs(jenkins-hbase4.apache.org,44767,1676142210757)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 19:03:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 19:03:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 19:03:36,449 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44767,1676142210757' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 19:03:36,450 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,450 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:36,451 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,451 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:36,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44767,1676142210757' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 19:03:36,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@171c8cb3[Count = 1] remaining members to acquire global barrier 2023-02-11 19:03:36,472 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f2/57c44b1d7b4e4768aed05018096d8e23 2023-02-11 19:03:36,477 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f1/4822338439c84ebbaac789f24510fb1b as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/4822338439c84ebbaac789f24510fb1b 2023-02-11 19:03:36,482 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/4822338439c84ebbaac789f24510fb1b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,483 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/.tmp/f2/57c44b1d7b4e4768aed05018096d8e23 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/57c44b1d7b4e4768aed05018096d8e23 2023-02-11 19:03:36,487 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/57c44b1d7b4e4768aed05018096d8e23, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:36,488 INFO [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 960b83fab17e015bbd62d62dd0c9d132 in 535ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:36,488 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 960b83fab17e015bbd62d62dd0c9d132: 2023-02-11 19:03:36,488 DEBUG [rs(jenkins-hbase4.apache.org,41511,1676142210828)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:36,488 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 19:03:36,488 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 19:03:36,489 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,489 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 19:03:36,489 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41511,1676142210828' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 19:03:36,490 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,490 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:36,491 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,491 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:36,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41511,1676142210828' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 19:03:36,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@171c8cb3[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:36,492 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 19:03:36,492 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,493 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,493 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,493 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 19:03:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 19:03:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,494 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 19:03:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 19:03:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44767,1676142210757' in zk 2023-02-11 19:03:36,494 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41511,1676142210828' in zk 2023-02-11 19:03:36,494 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,494 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 19:03:36,496 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:36,496 DEBUG [member: 'jenkins-hbase4.apache.org,41511,1676142210828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 19:03:36,497 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 19:03:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:36,497 DEBUG [member: 'jenkins-hbase4.apache.org,44767,1676142210757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 19:03:36,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:36,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41511,1676142210828': 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41511,1676142210828' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44767,1676142210757': 2023-02-11 19:03:36,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44767,1676142210757' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 19:03:36,504 INFO [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 19:03:36,504 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:36,504 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:36,504 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 19:03:36,504 INFO [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:03:36,506 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:36,506 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,506 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:36,506 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:36,507 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:36,509 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:03:36,509 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,512 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,512 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:36,512 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:36,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:36,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 19:03:36,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:03:36,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:36,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:36,513 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,513 DEBUG [(jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:36,515 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:36,515 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:36,515 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:03:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:36,516 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:03:36,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:36,613 DEBUG [Listener at localhost/34971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:03:36,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38695] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:03:36,615 INFO [Listener at localhost/34971] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:03:36,616 DEBUG [Listener at localhost/34971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e91186f to 127.0.0.1:53493 2023-02-11 19:03:36,616 DEBUG [Listener at localhost/34971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,616 DEBUG [Listener at localhost/34971] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:03:36,616 DEBUG [Listener at localhost/34971] util.JVMClusterUtil(257): Found active master hash=158149361, stopped=false 2023-02-11 19:03:36,616 INFO [Listener at localhost/34971] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:36,619 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:36,619 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:36,619 INFO [Listener at localhost/34971] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:03:36,619 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:36,620 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:36,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:36,624 DEBUG [Listener at localhost/34971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x257080d7 to 127.0.0.1:53493 2023-02-11 19:03:36,625 DEBUG [Listener at localhost/34971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:36,625 INFO [Listener at localhost/34971] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44767,1676142210757' ***** 2023-02-11 19:03:36,625 INFO [Listener at localhost/34971] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:36,625 INFO [Listener at localhost/34971] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41511,1676142210828' ***** 2023-02-11 19:03:36,625 INFO [Listener at localhost/34971] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:36,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:36,625 INFO [RS:1;jenkins-hbase4:41511] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:36,625 INFO [RS:1;jenkins-hbase4:41511] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:36,625 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:36,625 INFO [RS:1;jenkins-hbase4:41511] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:36,626 INFO [RS:0;jenkins-hbase4:44767] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:36,626 INFO [RS:0;jenkins-hbase4:44767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:36,626 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for 09e130595a19adb578ec79999ae2a5a7 2023-02-11 19:03:36,627 INFO [RS:0;jenkins-hbase4:44767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:36,626 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:36,627 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(3304): Received CLOSE for 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:36,627 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:36,627 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(3304): Received CLOSE for 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:36,627 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:36,628 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(3304): Received CLOSE for be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:36,628 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:36,628 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(3304): Received CLOSE for d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:36,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 09e130595a19adb578ec79999ae2a5a7, disabling compactions & flushes 2023-02-11 19:03:36,628 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(3304): Received CLOSE for de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:36,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9759e84fac8e33c759a4af887e07bd34, disabling compactions & flushes 2023-02-11 19:03:36,628 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,628 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:36,628 DEBUG [RS:0;jenkins-hbase4:44767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33dc6d52 to 127.0.0.1:53493 2023-02-11 19:03:36,628 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:36,628 DEBUG [RS:0;jenkins-hbase4:44767] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:36,628 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-11 19:03:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. after waiting 0 ms 2023-02-11 19:03:36,628 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1479): Online Regions={9759e84fac8e33c759a4af887e07bd34=testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34., 92d401a14d25c8dbf740d2b4625c54ac=testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac., be908093dbb006cd9be0fd4e23662c91=testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91., d19369f1367219909e3dd22efe0bb708=testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708., de0005f8ed15524083f68c4a7bfdd603=testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.} 2023-02-11 19:03:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:36,628 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,628 DEBUG [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1505): Waiting on 92d401a14d25c8dbf740d2b4625c54ac, 9759e84fac8e33c759a4af887e07bd34, be908093dbb006cd9be0fd4e23662c91, d19369f1367219909e3dd22efe0bb708, de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:36,628 DEBUG [RS:1;jenkins-hbase4:41511] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53ec0a19 to 127.0.0.1:53493 2023-02-11 19:03:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. after waiting 0 ms 2023-02-11 19:03:36,629 DEBUG [RS:1;jenkins-hbase4:41511] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:36,629 INFO [RS:1;jenkins-hbase4:41511] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:36,629 INFO [RS:1;jenkins-hbase4:41511] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:36,630 INFO [RS:1;jenkins-hbase4:41511] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:36,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 09e130595a19adb578ec79999ae2a5a7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:03:36,631 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:03:36,632 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-11 19:03:36,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:36,634 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:36,634 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:36,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:36,635 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1479): Online Regions={09e130595a19adb578ec79999ae2a5a7=hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7., 960b83fab17e015bbd62d62dd0c9d132=testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132., c7daa909645d90d5ac028087af882baa=testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa., d1328515bb4b6d89d2e0001e6e49fa12=testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12., c0ef05186abfbad195663be8d73ab9b0=testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0., 1588230740=hbase:meta,,1.1588230740, 0f948dab103d347915da84203011fbdc=testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.} 2023-02-11 19:03:36,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:36,636 DEBUG [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1505): Waiting on 09e130595a19adb578ec79999ae2a5a7, 0f948dab103d347915da84203011fbdc, 1588230740, 960b83fab17e015bbd62d62dd0c9d132, c0ef05186abfbad195663be8d73ab9b0, c7daa909645d90d5ac028087af882baa, d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:36,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:36,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:36,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-11 19:03:36,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:36,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9759e84fac8e33c759a4af887e07bd34: Waiting for close lock at 1676142216628Running coprocessor pre-close hooks at 1676142216628Disabling compacts and flushes for region at 1676142216628Disabling writes for close at 1676142216628Writing region close event to WAL at 1676142216635 (+7 ms)Running coprocessor post-close hooks at 1676142216640 (+5 ms)Closed at 1676142216640 2023-02-11 19:03:36,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:36,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 92d401a14d25c8dbf740d2b4625c54ac, disabling compactions & flushes 2023-02-11 19:03:36,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:36,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:36,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. after waiting 0 ms 2023-02-11 19:03:36,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:36,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:36,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 92d401a14d25c8dbf740d2b4625c54ac: Waiting for close lock at 1676142216641Running coprocessor pre-close hooks at 1676142216641Disabling compacts and flushes for region at 1676142216641Disabling writes for close at 1676142216641Writing region close event to WAL at 1676142216648 (+7 ms)Running coprocessor post-close hooks at 1676142216651 (+3 ms)Closed at 1676142216652 (+1 ms) 2023-02-11 19:03:36,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:36,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing be908093dbb006cd9be0fd4e23662c91, disabling compactions & flushes 2023-02-11 19:03:36,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:36,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:36,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. after waiting 0 ms 2023-02-11 19:03:36,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:36,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/.tmp/info/f4b1fc682ebe4f20ad660b5533497e5c 2023-02-11 19:03:36,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/.tmp/info/647da10fb8ac4fbd90a8060e88b68a93 2023-02-11 19:03:36,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:36,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for be908093dbb006cd9be0fd4e23662c91: Waiting for close lock at 1676142216652Running coprocessor pre-close hooks at 1676142216652Disabling compacts and flushes for region at 1676142216652Disabling writes for close at 1676142216653 (+1 ms)Writing region close event to WAL at 1676142216659 (+6 ms)Running coprocessor post-close hooks at 1676142216664 (+5 ms)Closed at 1676142216664 2023-02-11 19:03:36,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d19369f1367219909e3dd22efe0bb708, disabling compactions & flushes 2023-02-11 19:03:36,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. after waiting 0 ms 2023-02-11 19:03:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/.tmp/info/647da10fb8ac4fbd90a8060e88b68a93 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/info/647da10fb8ac4fbd90a8060e88b68a93 2023-02-11 19:03:36,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d19369f1367219909e3dd22efe0bb708: Waiting for close lock at 1676142216665Running coprocessor pre-close hooks at 1676142216665Disabling compacts and flushes for region at 1676142216665Disabling writes for close at 1676142216665Writing region close event to WAL at 1676142216673 (+8 ms)Running coprocessor post-close hooks at 1676142216677 (+4 ms)Closed at 1676142216678 (+1 ms) 2023-02-11 19:03:36,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:36,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing de0005f8ed15524083f68c4a7bfdd603, disabling compactions & flushes 2023-02-11 19:03:36,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. after waiting 0 ms 2023-02-11 19:03:36,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/info/647da10fb8ac4fbd90a8060e88b68a93, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:03:36,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 09e130595a19adb578ec79999ae2a5a7 in 52ms, sequenceid=6, compaction requested=false 2023-02-11 19:03:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 19:03:36,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/.tmp/table/4b6f3bd7ae2245bf89857228bed1b380 2023-02-11 19:03:36,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:03:36,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for de0005f8ed15524083f68c4a7bfdd603: Waiting for close lock at 1676142216678Running coprocessor pre-close hooks at 1676142216678Disabling compacts and flushes for region at 1676142216678Disabling writes for close at 1676142216678Writing region close event to WAL at 1676142216679 (+1 ms)Running coprocessor post-close hooks at 1676142216685 (+6 ms)Closed at 1676142216686 (+1 ms) 2023-02-11 19:03:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/namespace/09e130595a19adb578ec79999ae2a5a7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:03:36,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:36,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 09e130595a19adb578ec79999ae2a5a7: Waiting for close lock at 1676142216627Running coprocessor pre-close hooks at 1676142216627Disabling compacts and flushes for region at 1676142216627Disabling writes for close at 1676142216629 (+2 ms)Obtaining lock to block concurrent updates at 1676142216631 (+2 ms)Preparing flush snapshotting stores in 09e130595a19adb578ec79999ae2a5a7 at 1676142216631Finished memstore snapshotting hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142216632 (+1 ms)Flushing stores of hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. at 1676142216636 (+4 ms)Flushing 09e130595a19adb578ec79999ae2a5a7/info: creating writer at 1676142216636Flushing 09e130595a19adb578ec79999ae2a5a7/info: appending metadata at 1676142216639 (+3 ms)Flushing 09e130595a19adb578ec79999ae2a5a7/info: closing flushed file at 1676142216639Flushing 09e130595a19adb578ec79999ae2a5a7/info: reopening flushed file at 1676142216674 (+35 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 09e130595a19adb578ec79999ae2a5a7 in 52ms, sequenceid=6, compaction requested=false at 1676142216681 (+7 ms)Writing region close event to WAL at 1676142216683 (+2 ms)Running coprocessor post-close hooks at 1676142216687 (+4 ms)Closed at 1676142216687 2023-02-11 19:03:36,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142211545.09e130595a19adb578ec79999ae2a5a7. 2023-02-11 19:03:36,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 960b83fab17e015bbd62d62dd0c9d132, disabling compactions & flushes 2023-02-11 19:03:36,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:36,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:36,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. after waiting 0 ms 2023-02-11 19:03:36,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:36,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/.tmp/info/f4b1fc682ebe4f20ad660b5533497e5c as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/info/f4b1fc682ebe4f20ad660b5533497e5c 2023-02-11 19:03:36,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 960b83fab17e015bbd62d62dd0c9d132: Waiting for close lock at 1676142216688Running coprocessor pre-close hooks at 1676142216688Disabling compacts and flushes for region at 1676142216688Disabling writes for close at 1676142216688Writing region close event to WAL at 1676142216689 (+1 ms)Running coprocessor post-close hooks at 1676142216692 (+3 ms)Closed at 1676142216693 (+1 ms) 2023-02-11 19:03:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7daa909645d90d5ac028087af882baa, disabling compactions & flushes 2023-02-11 19:03:36,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. after waiting 0 ms 2023-02-11 19:03:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:36,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/info/f4b1fc682ebe4f20ad660b5533497e5c, entries=110, sequenceid=32, filesize=18.7 K 2023-02-11 19:03:36,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/.tmp/table/4b6f3bd7ae2245bf89857228bed1b380 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/table/4b6f3bd7ae2245bf89857228bed1b380 2023-02-11 19:03:36,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:03:36,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:36,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7daa909645d90d5ac028087af882baa: Waiting for close lock at 1676142216693Running coprocessor pre-close hooks at 1676142216693Disabling compacts and flushes for region at 1676142216693Disabling writes for close at 1676142216693Writing region close event to WAL at 1676142216693Running coprocessor post-close hooks at 1676142216697 (+4 ms)Closed at 1676142216698 (+1 ms) 2023-02-11 19:03:36,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:36,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d1328515bb4b6d89d2e0001e6e49fa12, disabling compactions & flushes 2023-02-11 19:03:36,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:36,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:36,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. after waiting 0 ms 2023-02-11 19:03:36,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:36,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/table/4b6f3bd7ae2245bf89857228bed1b380, entries=4, sequenceid=32, filesize=4.8 K 2023-02-11 19:03:36,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=32, compaction requested=false 2023-02-11 19:03:36,702 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 19:03:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:36,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d1328515bb4b6d89d2e0001e6e49fa12: Waiting for close lock at 1676142216698Running coprocessor pre-close hooks at 1676142216698Disabling compacts and flushes for region at 1676142216698Disabling writes for close at 1676142216699 (+1 ms)Writing region close event to WAL at 1676142216700 (+1 ms)Running coprocessor post-close hooks at 1676142216708 (+8 ms)Closed at 1676142216708 2023-02-11 19:03:36,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:36,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c0ef05186abfbad195663be8d73ab9b0, disabling compactions & flushes 2023-02-11 19:03:36,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:36,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:36,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. after waiting 0 ms 2023-02-11 19:03:36,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:36,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-11 19:03:36,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:36,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:36,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142216634Running coprocessor pre-close hooks at 1676142216634Disabling compacts and flushes for region at 1676142216634Disabling writes for close at 1676142216636 (+2 ms)Obtaining lock to block concurrent updates at 1676142216636Preparing flush snapshotting stores in 1588230740 at 1676142216636Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676142216636Flushing stores of hbase:meta,,1.1588230740 at 1676142216637 (+1 ms)Flushing 1588230740/info: creating writer at 1676142216637Flushing 1588230740/info: appending metadata at 1676142216639 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676142216639Flushing 1588230740/table: creating writer at 1676142216663 (+24 ms)Flushing 1588230740/table: appending metadata at 1676142216673 (+10 ms)Flushing 1588230740/table: closing flushed file at 1676142216673Flushing 1588230740/info: reopening flushed file at 1676142216689 (+16 ms)Flushing 1588230740/table: reopening flushed file at 1676142216695 (+6 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=32, compaction requested=false at 1676142216702 (+7 ms)Writing region close event to WAL at 1676142216708 (+6 ms)Running coprocessor post-close hooks at 1676142216716 (+8 ms)Closed at 1676142216716 2023-02-11 19:03:36,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:36,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c0ef05186abfbad195663be8d73ab9b0: Waiting for close lock at 1676142216709Running coprocessor pre-close hooks at 1676142216709Disabling compacts and flushes for region at 1676142216709Disabling writes for close at 1676142216709Writing region close event to WAL at 1676142216710 (+1 ms)Running coprocessor post-close hooks at 1676142216721 (+11 ms)Closed at 1676142216721 2023-02-11 19:03:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0f948dab103d347915da84203011fbdc, disabling compactions & flushes 2023-02-11 19:03:36,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. after waiting 0 ms 2023-02-11 19:03:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:36,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0f948dab103d347915da84203011fbdc: Waiting for close lock at 1676142216721Running coprocessor pre-close hooks at 1676142216721Disabling compacts and flushes for region at 1676142216721Disabling writes for close at 1676142216721Writing region close event to WAL at 1676142216724 (+3 ms)Running coprocessor post-close hooks at 1676142216726 (+2 ms)Closed at 1676142216726 2023-02-11 19:03:36,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:36,829 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44767,1676142210757; all regions closed. 2023-02-11 19:03:36,833 DEBUG [RS:0;jenkins-hbase4:44767] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/oldWALs 2023-02-11 19:03:36,833 INFO [RS:0;jenkins-hbase4:44767] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44767%2C1676142210757:(num 1676142212304) 2023-02-11 19:03:36,833 DEBUG [RS:0;jenkins-hbase4:44767] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,833 INFO [RS:0;jenkins-hbase4:44767] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:36,834 INFO [RS:0;jenkins-hbase4:44767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:36,834 INFO [RS:0;jenkins-hbase4:44767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:36,834 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:36,834 INFO [RS:0;jenkins-hbase4:44767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:36,834 INFO [RS:0;jenkins-hbase4:44767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:36,835 INFO [RS:0;jenkins-hbase4:44767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44767 2023-02-11 19:03:36,836 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41511,1676142210828; all regions closed. 2023-02-11 19:03:36,838 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,838 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:36,838 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:36,838 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58d86ec5 rejected from java.util.concurrent.ThreadPoolExecutor@5ce7f106[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:36,838 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44767,1676142210757 2023-02-11 19:03:36,839 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:36,839 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44767,1676142210757] 2023-02-11 19:03:36,839 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44767,1676142210757; numProcessing=1 2023-02-11 19:03:36,840 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44767,1676142210757 already deleted, retry=false 2023-02-11 19:03:36,841 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44767,1676142210757 expired; onlineServers=1 2023-02-11 19:03:36,841 DEBUG [RS:1;jenkins-hbase4:41511] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/oldWALs 2023-02-11 19:03:36,842 INFO [RS:1;jenkins-hbase4:41511] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41511%2C1676142210828.meta:.meta(num 1676142211481) 2023-02-11 19:03:36,847 DEBUG [RS:1;jenkins-hbase4:41511] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/oldWALs 2023-02-11 19:03:36,847 INFO [RS:1;jenkins-hbase4:41511] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41511%2C1676142210828:(num 1676142211914) 2023-02-11 19:03:36,847 DEBUG [RS:1;jenkins-hbase4:41511] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,847 INFO [RS:1;jenkins-hbase4:41511] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:36,847 INFO [RS:1;jenkins-hbase4:41511] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:36,847 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:36,848 INFO [RS:1;jenkins-hbase4:41511] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41511 2023-02-11 19:03:36,851 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41511,1676142210828 2023-02-11 19:03:36,851 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:36,851 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31885f4e rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:36,852 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41511,1676142210828] 2023-02-11 19:03:36,852 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41511,1676142210828; numProcessing=2 2023-02-11 19:03:36,854 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41511,1676142210828 already deleted, retry=false 2023-02-11 19:03:36,854 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41511,1676142210828 expired; onlineServers=0 2023-02-11 19:03:36,854 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38695,1676142210691' ***** 2023-02-11 19:03:36,854 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:03:36,855 DEBUG [M:0;jenkins-hbase4:38695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@485020ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:36,855 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38695,1676142210691 2023-02-11 19:03:36,855 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38695,1676142210691; all regions closed. 2023-02-11 19:03:36,855 DEBUG [M:0;jenkins-hbase4:38695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:36,855 DEBUG [M:0;jenkins-hbase4:38695] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:03:36,855 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:03:36,855 DEBUG [M:0;jenkins-hbase4:38695] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:03:36,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142211109] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142211109,5,FailOnTimeoutGroup] 2023-02-11 19:03:36,856 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:36,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142211108] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142211108,5,FailOnTimeoutGroup] 2023-02-11 19:03:36,856 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:36,856 INFO [M:0;jenkins-hbase4:38695] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:03:36,857 INFO [M:0;jenkins-hbase4:38695] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:03:36,857 INFO [M:0;jenkins-hbase4:38695] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:03:36,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:36,857 DEBUG [M:0;jenkins-hbase4:38695] master.HMaster(1502): Stopping service threads 2023-02-11 19:03:36,857 INFO [M:0;jenkins-hbase4:38695] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:03:36,858 ERROR [M:0;jenkins-hbase4:38695] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:03:36,858 INFO [M:0;jenkins-hbase4:38695] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:03:36,858 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:03:36,858 DEBUG [M:0;jenkins-hbase4:38695] zookeeper.ZKUtil(398): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:03:36,858 WARN [M:0;jenkins-hbase4:38695] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:03:36,858 INFO [M:0;jenkins-hbase4:38695] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:03:36,859 INFO [M:0;jenkins-hbase4:38695] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:03:36,859 DEBUG [M:0;jenkins-hbase4:38695] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:36,859 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:36,859 DEBUG [M:0;jenkins-hbase4:38695] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:36,859 DEBUG [M:0;jenkins-hbase4:38695] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:36,859 DEBUG [M:0;jenkins-hbase4:38695] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:36,859 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-11 19:03:36,868 INFO [M:0;jenkins-hbase4:38695] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/247c3902a77a4786870811b4e1e0f173 2023-02-11 19:03:36,874 DEBUG [M:0;jenkins-hbase4:38695] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/247c3902a77a4786870811b4e1e0f173 as hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/247c3902a77a4786870811b4e1e0f173 2023-02-11 19:03:36,879 INFO [M:0;jenkins-hbase4:38695] regionserver.HStore(1080): Added hdfs://localhost:33995/user/jenkins/test-data/f58fcd1e-f509-b78a-0a05-8f59c8943fea/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/247c3902a77a4786870811b4e1e0f173, entries=31, sequenceid=218, filesize=9.0 K 2023-02-11 19:03:36,880 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false 2023-02-11 19:03:36,880 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:36,880 DEBUG [M:0;jenkins-hbase4:38695] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142216859Disabling compacts and flushes for region at 1676142216859Disabling writes for close at 1676142216859Obtaining lock to block concurrent updates at 1676142216859Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142216859Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676142216859Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142216860 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142216860Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142216863 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142216863Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142216875 (+12 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false at 1676142216880 (+5 ms)Writing region close event to WAL at 1676142216880Closed at 1676142216880 2023-02-11 19:03:36,884 INFO [M:0;jenkins-hbase4:38695] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:03:36,884 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:36,885 INFO [M:0;jenkins-hbase4:38695] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38695 2023-02-11 19:03:36,889 DEBUG [M:0;jenkins-hbase4:38695] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38695,1676142210691 already deleted, retry=false 2023-02-11 19:03:37,120 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:37,120 INFO [M:0;jenkins-hbase4:38695] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38695,1676142210691; zookeeper connection closed. 2023-02-11 19:03:37,120 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72e006b0 rejected from java.util.concurrent.ThreadPoolExecutor@76df9c34[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:37,121 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): master:38695-0x10044c458280000, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:37,121 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70035063 rejected from java.util.concurrent.ThreadPoolExecutor@76df9c34[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:37,220 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:37,220 INFO [RS:1;jenkins-hbase4:41511] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41511,1676142210828; zookeeper connection closed. 2023-02-11 19:03:37,220 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@328eacba rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:37,220 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:41511-0x10044c458280002, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:37,220 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e338df6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e338df6 2023-02-11 19:03:37,220 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a5e40f9 rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:37,320 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:37,320 INFO [RS:0;jenkins-hbase4:44767] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44767,1676142210757; zookeeper connection closed. 2023-02-11 19:03:37,320 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3383919e rejected from java.util.concurrent.ThreadPoolExecutor@5ce7f106[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:37,321 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a394896] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a394896 2023-02-11 19:03:37,321 DEBUG [Listener at localhost/34971-EventThread] zookeeper.ZKWatcher(600): regionserver:44767-0x10044c458280001, quorum=127.0.0.1:53493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:37,321 ERROR [Listener at localhost/34971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bbad4ac rejected from java.util.concurrent.ThreadPoolExecutor@5ce7f106[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:37,321 INFO [Listener at localhost/34971] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:03:37,409 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop-7742222124528268005.jar 2023-02-11 19:03:37,414 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676142214538 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:37,414 DEBUG [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce 2023-02-11 19:03:37,414 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:37,414 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:37,414 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:37,414 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:37,414 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(239): region to add: de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=960b83fab17e015bbd62d62dd0c9d132 as 960b83fab17e015bbd62d62dd0c9d132 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=c7daa909645d90d5ac028087af882baa as c7daa909645d90d5ac028087af882baa in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=c0ef05186abfbad195663be8d73ab9b0 as c0ef05186abfbad195663be8d73ab9b0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=d1328515bb4b6d89d2e0001e6e49fa12 as d1328515bb4b6d89d2e0001e6e49fa12 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=9759e84fac8e33c759a4af887e07bd34 as 9759e84fac8e33c759a4af887e07bd34 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=92d401a14d25c8dbf740d2b4625c54ac as 92d401a14d25c8dbf740d2b4625c54ac in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=be908093dbb006cd9be0fd4e23662c91 as be908093dbb006cd9be0fd4e23662c91 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=d19369f1367219909e3dd22efe0bb708 as d19369f1367219909e3dd22efe0bb708 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=0f948dab103d347915da84203011fbdc as 0f948dab103d347915da84203011fbdc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,415 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(585): clone region=de0005f8ed15524083f68c4a7bfdd603 as de0005f8ed15524083f68c4a7bfdd603 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => d19369f1367219909e3dd22efe0bb708, NAME => 'testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => c7daa909645d90d5ac028087af882baa, NAME => 'testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => be908093dbb006cd9be0fd4e23662c91, NAME => 'testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => d1328515bb4b6d89d2e0001e6e49fa12, NAME => 'testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 960b83fab17e015bbd62d62dd0c9d132, NAME => 'testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c0ef05186abfbad195663be8d73ab9b0, NAME => 'testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 9759e84fac8e33c759a4af887e07bd34, NAME => 'testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,418 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 92d401a14d25c8dbf740d2b4625c54ac, NAME => 'testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,442 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,442 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing c7daa909645d90d5ac028087af882baa, disabling compactions & flushes 2023-02-11 19:03:37,443 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:37,443 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:37,443 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. after waiting 0 ms 2023-02-11 19:03:37,443 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:37,443 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:37,443 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for c7daa909645d90d5ac028087af882baa: Waiting for close lock at 1676142217442Disabling compacts and flushes for region at 1676142217442Disabling writes for close at 1676142217443 (+1 ms)Writing region close event to WAL at 1676142217443Closed at 1676142217443 2023-02-11 19:03:37,443 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0f948dab103d347915da84203011fbdc, NAME => 'testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,445 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,445 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 42959f4102884fe8b0901a74adca2e57 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,452 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,452 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0eaf8c4582b43358d100d2b17fde927 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,453 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 19f26747615f403aa7d74143ac402a63 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,456 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,456 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 52f46bfa018b4ab5b7dd7b9a9e1bcd95 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,457 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing d19369f1367219909e3dd22efe0bb708, disabling compactions & flushes 2023-02-11 19:03:37,457 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,458 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:37,458 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:37,458 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. after waiting 0 ms 2023-02-11 19:03:37,458 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:37,458 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:37,458 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 418e9190f52444e6af5dbf2b0beb3a36 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,458 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for d19369f1367219909e3dd22efe0bb708: Waiting for close lock at 1676142217457Disabling compacts and flushes for region at 1676142217457Disabling writes for close at 1676142217458 (+1 ms)Writing region close event to WAL at 1676142217458Closed at 1676142217458 2023-02-11 19:03:37,459 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => de0005f8ed15524083f68c4a7bfdd603, NAME => 'testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,459 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,459 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink faa8f0610ea0444b9f8bbf03326975f3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,460 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 584718eded8b43f498e2ce09debd3891 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,460 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,460 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f911c6d3426452691a3cdce39c13688 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,461 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,461 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink edbf51b512e245829d6e9ae0dfe7bfc4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,461 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4ffc449fa3748e6bfd8dd97ac77afd0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,464 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink efb9cbe388fe4b61a1169a28d7199b42 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,468 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 960b83fab17e015bbd62d62dd0c9d132, disabling compactions & flushes 2023-02-11 19:03:37,469 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,469 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4bc3b4c90b644d3db95946f1a5b5f7aa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,469 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a4802df525254e5ca1c17fe4872963c2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,469 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:37,469 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:37,469 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. after waiting 0 ms 2023-02-11 19:03:37,469 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:37,469 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:37,469 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 960b83fab17e015bbd62d62dd0c9d132: Waiting for close lock at 1676142217468Disabling compacts and flushes for region at 1676142217468Disabling writes for close at 1676142217469 (+1 ms)Writing region close event to WAL at 1676142217469Closed at 1676142217469 2023-02-11 19:03:37,472 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c02f8bc1ee24e9db63ca4a3dd3d235e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,475 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b9e90d8cc59d47ed9c76ae24e928cbdc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,475 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c0ef05186abfbad195663be8d73ab9b0, disabling compactions & flushes 2023-02-11 19:03:37,476 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. after waiting 0 ms 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 9759e84fac8e33c759a4af887e07bd34, disabling compactions & flushes 2023-02-11 19:03:37,476 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f99c2bad4adf40a18849f2d17fca4d2c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:37,476 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c0ef05186abfbad195663be8d73ab9b0: Waiting for close lock at 1676142217475Disabling compacts and flushes for region at 1676142217475Disabling writes for close at 1676142217476 (+1 ms)Writing region close event to WAL at 1676142217476Closed at 1676142217476 2023-02-11 19:03:37,476 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. after waiting 0 ms 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:37,476 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:37,476 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 9759e84fac8e33c759a4af887e07bd34: Waiting for close lock at 1676142217476Disabling compacts and flushes for region at 1676142217476Disabling writes for close at 1676142217476Writing region close event to WAL at 1676142217476Closed at 1676142217476 2023-02-11 19:03:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing d1328515bb4b6d89d2e0001e6e49fa12, disabling compactions & flushes 2023-02-11 19:03:37,477 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. after waiting 0 ms 2023-02-11 19:03:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:37,477 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for d1328515bb4b6d89d2e0001e6e49fa12: Waiting for close lock at 1676142217476Disabling compacts and flushes for region at 1676142217476Disabling writes for close at 1676142217477 (+1 ms)Writing region close event to WAL at 1676142217477Closed at 1676142217477 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing be908093dbb006cd9be0fd4e23662c91, disabling compactions & flushes 2023-02-11 19:03:37,478 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. after waiting 0 ms 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0f948dab103d347915da84203011fbdc, disabling compactions & flushes 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:37,478 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 92d401a14d25c8dbf740d2b4625c54ac, disabling compactions & flushes 2023-02-11 19:03:37,478 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:37,478 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:37,478 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for be908093dbb006cd9be0fd4e23662c91: Waiting for close lock at 1676142217478Disabling compacts and flushes for region at 1676142217478Disabling writes for close at 1676142217478Writing region close event to WAL at 1676142217478Closed at 1676142217478 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. after waiting 0 ms 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. after waiting 0 ms 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:37,479 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:37,479 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 92d401a14d25c8dbf740d2b4625c54ac: Waiting for close lock at 1676142217478Disabling compacts and flushes for region at 1676142217478Disabling writes for close at 1676142217479 (+1 ms)Writing region close event to WAL at 1676142217479Closed at 1676142217479 2023-02-11 19:03:37,479 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0f948dab103d347915da84203011fbdc: Waiting for close lock at 1676142217478Disabling compacts and flushes for region at 1676142217478Disabling writes for close at 1676142217479 (+1 ms)Writing region close event to WAL at 1676142217479Closed at 1676142217479 2023-02-11 19:03:37,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:37,482 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing de0005f8ed15524083f68c4a7bfdd603, disabling compactions & flushes 2023-02-11 19:03:37,482 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:37,482 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:37,482 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. after waiting 0 ms 2023-02-11 19:03:37,482 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:37,482 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:37,482 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for de0005f8ed15524083f68c4a7bfdd603: Waiting for close lock at 1676142217482Disabling compacts and flushes for region at 1676142217482Disabling writes for close at 1676142217482Writing region close event to WAL at 1676142217482Closed at 1676142217482 2023-02-11 19:03:37,482 INFO [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676142214538 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:37,482 DEBUG [Listener at localhost/34971] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,482 DEBUG [Listener at localhost/34971] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c 2023-02-11 19:03:37,483 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-data/ 2023-02-11 19:03:37,483 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----default/ 2023-02-11 19:03:37,484 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 19:03:37,484 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------0f948dab103d347915da84203011fbdc/ 2023-02-11 19:03:37,485 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,485 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,485 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=0f948dab103d347915da84203011fbdc-a4802df525254e5ca1c17fe4872963c2 2023-02-11 19:03:37,485 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,485 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=0f948dab103d347915da84203011fbdc-b9e90d8cc59d47ed9c76ae24e928cbdc 2023-02-11 19:03:37,486 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------92d401a14d25c8dbf740d2b4625c54ac/ 2023-02-11 19:03:37,486 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,486 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,486 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=92d401a14d25c8dbf740d2b4625c54ac-edbf51b512e245829d6e9ae0dfe7bfc4 2023-02-11 19:03:37,486 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,487 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=92d401a14d25c8dbf740d2b4625c54ac-f99c2bad4adf40a18849f2d17fca4d2c 2023-02-11 19:03:37,487 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------960b83fab17e015bbd62d62dd0c9d132/ 2023-02-11 19:03:37,487 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,487 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,488 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=960b83fab17e015bbd62d62dd0c9d132-52f46bfa018b4ab5b7dd7b9a9e1bcd95 2023-02-11 19:03:37,488 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,489 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=960b83fab17e015bbd62d62dd0c9d132-584718eded8b43f498e2ce09debd3891 2023-02-11 19:03:37,489 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------9759e84fac8e33c759a4af887e07bd34/ 2023-02-11 19:03:37,489 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,489 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,490 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=9759e84fac8e33c759a4af887e07bd34-e0eaf8c4582b43358d100d2b17fde927 2023-02-11 19:03:37,490 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,490 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=9759e84fac8e33c759a4af887e07bd34-e4ffc449fa3748e6bfd8dd97ac77afd0 2023-02-11 19:03:37,491 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------be908093dbb006cd9be0fd4e23662c91/ 2023-02-11 19:03:37,491 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,491 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,492 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=be908093dbb006cd9be0fd4e23662c91-faa8f0610ea0444b9f8bbf03326975f3 2023-02-11 19:03:37,492 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,492 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=be908093dbb006cd9be0fd4e23662c91-9c02f8bc1ee24e9db63ca4a3dd3d235e 2023-02-11 19:03:37,492 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------c0ef05186abfbad195663be8d73ab9b0/ 2023-02-11 19:03:37,493 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,493 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,494 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=c0ef05186abfbad195663be8d73ab9b0-418e9190f52444e6af5dbf2b0beb3a36 2023-02-11 19:03:37,494 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,494 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=c0ef05186abfbad195663be8d73ab9b0-efb9cbe388fe4b61a1169a28d7199b42 2023-02-11 19:03:37,494 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------c7daa909645d90d5ac028087af882baa/ 2023-02-11 19:03:37,495 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,495 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------d1328515bb4b6d89d2e0001e6e49fa12/ 2023-02-11 19:03:37,495 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,495 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,496 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=d1328515bb4b6d89d2e0001e6e49fa12-1f911c6d3426452691a3cdce39c13688 2023-02-11 19:03:37,496 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,496 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=d1328515bb4b6d89d2e0001e6e49fa12-4bc3b4c90b644d3db95946f1a5b5f7aa 2023-02-11 19:03:37,496 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------d19369f1367219909e3dd22efe0bb708/ 2023-02-11 19:03:37,497 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,497 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:37,497 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=d19369f1367219909e3dd22efe0bb708-42959f4102884fe8b0901a74adca2e57 2023-02-11 19:03:37,497 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:37,498 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |----------------testWithMapReduce=d19369f1367219909e3dd22efe0bb708-19f26747615f403aa7d74143ac402a63 2023-02-11 19:03:37,498 DEBUG [Listener at localhost/34971] util.CommonFSUtils(699): |----------de0005f8ed15524083f68c4a7bfdd603/ 2023-02-11 19:03:37,499 DEBUG [Listener at localhost/34971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:37,499 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:37,500 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:37,501 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:37,501 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,385 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop-5028828381966149535.jar 2023-02-11 19:03:38,385 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,386 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,451 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop-3451319221122496299.jar 2023-02-11 19:03:38,452 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,452 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,453 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,453 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,453 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,454 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,454 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 19:03:38,454 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 19:03:38,455 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 19:03:38,455 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 19:03:38,455 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 19:03:38,456 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 19:03:38,456 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 19:03:38,457 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 19:03:38,457 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 19:03:38,458 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 19:03:38,458 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 19:03:38,458 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:03:38,459 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:03:38,459 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:03:38,460 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 19:03:38,527 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop-3674219518549129587.jar 2023-02-11 19:03:38,528 DEBUG [Listener at localhost/34971] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 19:03:38,533 WARN [Listener at localhost/34971] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 19:03:38,545 WARN [Listener at localhost/34971] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-11 19:03:38,574 INFO [Listener at localhost/34971] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 19:03:38,700 WARN [Listener at localhost/34971] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/mapreduce.cluster.local.dir/1676142218667/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 19:03:38,700 WARN [Listener at localhost/34971] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/mapreduce.cluster.local.dir/1676142218667/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 19:03:38,734 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:38,735 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:38,735 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:38,737 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:38,738 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1 2023-02-11 19:03:38,739 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92d401a14d25c8dbf740d2b4625c54ac columnFamilyName f1 2023-02-11 19:03:38,745 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f1/testWithMapReduce=92d401a14d25c8dbf740d2b4625c54ac-edbf51b512e245829d6e9ae0dfe7bfc4 2023-02-11 19:03:38,745 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(310): Store=92d401a14d25c8dbf740d2b4625c54ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,745 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92d401a14d25c8dbf740d2b4625c54ac 2023-02-11 19:03:38,746 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2 2023-02-11 19:03:38,747 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92d401a14d25c8dbf740d2b4625c54ac columnFamilyName f2 2023-02-11 19:03:38,752 DEBUG [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/92d401a14d25c8dbf740d2b4625c54ac/f2/testWithMapReduce=92d401a14d25c8dbf740d2b4625c54ac-f99c2bad4adf40a18849f2d17fca4d2c 2023-02-11 19:03:38,752 INFO [StoreOpener-92d401a14d25c8dbf740d2b4625c54ac-1] regionserver.HStore(310): Store=92d401a14d25c8dbf740d2b4625c54ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,752 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:38,752 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 92d401a14d25c8dbf740d2b4625c54ac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73663106, jitterRate=0.09766581654548645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:38,752 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 92d401a14d25c8dbf740d2b4625c54ac: Writing region info on filesystem at 1676142218736Initializing all the Stores at 1676142218737 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218737Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218737Region opened successfully at 1676142218752 (+15 ms) 2023-02-11 19:03:38,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 92d401a14d25c8dbf740d2b4625c54ac, disabling compactions & flushes 2023-02-11 19:03:38,783 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:38,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:38,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. after waiting 0 ms 2023-02-11 19:03:38,784 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:38,784 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676142212190.92d401a14d25c8dbf740d2b4625c54ac. 2023-02-11 19:03:38,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 92d401a14d25c8dbf740d2b4625c54ac: Waiting for close lock at 1676142218783Disabling compacts and flushes for region at 1676142218783Disabling writes for close at 1676142218784 (+1 ms)Writing region close event to WAL at 1676142218784Closed at 1676142218784 2023-02-11 19:03:38,787 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:38,787 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:38,790 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:38,792 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:38,793 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1 2023-02-11 19:03:38,793 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f948dab103d347915da84203011fbdc columnFamilyName f1 2023-02-11 19:03:38,798 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f1/testWithMapReduce=0f948dab103d347915da84203011fbdc-a4802df525254e5ca1c17fe4872963c2 2023-02-11 19:03:38,798 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(310): Store=0f948dab103d347915da84203011fbdc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,799 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f948dab103d347915da84203011fbdc 2023-02-11 19:03:38,799 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2 2023-02-11 19:03:38,800 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f948dab103d347915da84203011fbdc columnFamilyName f2 2023-02-11 19:03:38,804 DEBUG [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/0f948dab103d347915da84203011fbdc/f2/testWithMapReduce=0f948dab103d347915da84203011fbdc-b9e90d8cc59d47ed9c76ae24e928cbdc 2023-02-11 19:03:38,804 INFO [StoreOpener-0f948dab103d347915da84203011fbdc-1] regionserver.HStore(310): Store=0f948dab103d347915da84203011fbdc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,804 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:38,805 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0f948dab103d347915da84203011fbdc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67675392, jitterRate=0.008441925048828125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:38,805 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0f948dab103d347915da84203011fbdc: Writing region info on filesystem at 1676142218790Initializing all the Stores at 1676142218791 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218791Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218791Region opened successfully at 1676142218805 (+14 ms) 2023-02-11 19:03:38,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0f948dab103d347915da84203011fbdc, disabling compactions & flushes 2023-02-11 19:03:38,833 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:38,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:38,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. after waiting 0 ms 2023-02-11 19:03:38,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:38,834 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676142212190.0f948dab103d347915da84203011fbdc. 2023-02-11 19:03:38,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0f948dab103d347915da84203011fbdc: Waiting for close lock at 1676142218833Disabling compacts and flushes for region at 1676142218833Disabling writes for close at 1676142218833Writing region close event to WAL at 1676142218834 (+1 ms)Closed at 1676142218834 2023-02-11 19:03:38,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:38,838 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:38,840 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:38,841 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:38,842 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1 2023-02-11 19:03:38,842 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9759e84fac8e33c759a4af887e07bd34 columnFamilyName f1 2023-02-11 19:03:38,847 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f1/testWithMapReduce=9759e84fac8e33c759a4af887e07bd34-e0eaf8c4582b43358d100d2b17fde927 2023-02-11 19:03:38,847 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(310): Store=9759e84fac8e33c759a4af887e07bd34/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,847 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9759e84fac8e33c759a4af887e07bd34 2023-02-11 19:03:38,848 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2 2023-02-11 19:03:38,848 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9759e84fac8e33c759a4af887e07bd34 columnFamilyName f2 2023-02-11 19:03:38,853 DEBUG [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/9759e84fac8e33c759a4af887e07bd34/f2/testWithMapReduce=9759e84fac8e33c759a4af887e07bd34-e4ffc449fa3748e6bfd8dd97ac77afd0 2023-02-11 19:03:38,853 INFO [StoreOpener-9759e84fac8e33c759a4af887e07bd34-1] regionserver.HStore(310): Store=9759e84fac8e33c759a4af887e07bd34/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:38,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9759e84fac8e33c759a4af887e07bd34; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64107031, jitterRate=-0.04473079741001129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:38,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9759e84fac8e33c759a4af887e07bd34: Writing region info on filesystem at 1676142218840Initializing all the Stores at 1676142218841 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218841Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218841Region opened successfully at 1676142218853 (+12 ms) 2023-02-11 19:03:38,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9759e84fac8e33c759a4af887e07bd34, disabling compactions & flushes 2023-02-11 19:03:38,888 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:38,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:38,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. after waiting 0 ms 2023-02-11 19:03:38,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:38,889 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676142212190.9759e84fac8e33c759a4af887e07bd34. 2023-02-11 19:03:38,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9759e84fac8e33c759a4af887e07bd34: Waiting for close lock at 1676142218888Disabling compacts and flushes for region at 1676142218888Disabling writes for close at 1676142218888Writing region close event to WAL at 1676142218889 (+1 ms)Closed at 1676142218889 2023-02-11 19:03:38,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:38,893 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:38,894 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:38,896 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:38,897 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1 2023-02-11 19:03:38,897 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 960b83fab17e015bbd62d62dd0c9d132 columnFamilyName f1 2023-02-11 19:03:38,902 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f1/testWithMapReduce=960b83fab17e015bbd62d62dd0c9d132-52f46bfa018b4ab5b7dd7b9a9e1bcd95 2023-02-11 19:03:38,902 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(310): Store=960b83fab17e015bbd62d62dd0c9d132/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,902 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 960b83fab17e015bbd62d62dd0c9d132 2023-02-11 19:03:38,903 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2 2023-02-11 19:03:38,903 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 960b83fab17e015bbd62d62dd0c9d132 columnFamilyName f2 2023-02-11 19:03:38,907 DEBUG [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/960b83fab17e015bbd62d62dd0c9d132/f2/testWithMapReduce=960b83fab17e015bbd62d62dd0c9d132-584718eded8b43f498e2ce09debd3891 2023-02-11 19:03:38,907 INFO [StoreOpener-960b83fab17e015bbd62d62dd0c9d132-1] regionserver.HStore(310): Store=960b83fab17e015bbd62d62dd0c9d132/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:38,907 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 960b83fab17e015bbd62d62dd0c9d132; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61145689, jitterRate=-0.0888582319021225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:38,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 960b83fab17e015bbd62d62dd0c9d132: Writing region info on filesystem at 1676142218894Initializing all the Stores at 1676142218895 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218895Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218895Region opened successfully at 1676142218907 (+12 ms) 2023-02-11 19:03:38,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 960b83fab17e015bbd62d62dd0c9d132, disabling compactions & flushes 2023-02-11 19:03:38,945 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:38,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:38,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. after waiting 0 ms 2023-02-11 19:03:38,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:38,946 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676142212190.960b83fab17e015bbd62d62dd0c9d132. 2023-02-11 19:03:38,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 960b83fab17e015bbd62d62dd0c9d132: Waiting for close lock at 1676142218945Disabling compacts and flushes for region at 1676142218945Disabling writes for close at 1676142218946 (+1 ms)Writing region close event to WAL at 1676142218946Closed at 1676142218946 2023-02-11 19:03:38,950 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:38,950 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:38,955 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:38,957 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:38,958 DEBUG [StoreOpener-c7daa909645d90d5ac028087af882baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/f1 2023-02-11 19:03:38,958 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7daa909645d90d5ac028087af882baa columnFamilyName f1 2023-02-11 19:03:38,959 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(310): Store=c7daa909645d90d5ac028087af882baa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,959 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7daa909645d90d5ac028087af882baa 2023-02-11 19:03:38,960 DEBUG [StoreOpener-c7daa909645d90d5ac028087af882baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/c7daa909645d90d5ac028087af882baa/f2 2023-02-11 19:03:38,961 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7daa909645d90d5ac028087af882baa columnFamilyName f2 2023-02-11 19:03:38,961 INFO [StoreOpener-c7daa909645d90d5ac028087af882baa-1] regionserver.HStore(310): Store=c7daa909645d90d5ac028087af882baa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:38,962 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c7daa909645d90d5ac028087af882baa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70219403, jitterRate=0.046350643038749695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:38,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c7daa909645d90d5ac028087af882baa: Writing region info on filesystem at 1676142218955Initializing all the Stores at 1676142218956 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218956Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218956Region opened successfully at 1676142218962 (+6 ms) 2023-02-11 19:03:38,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c7daa909645d90d5ac028087af882baa, disabling compactions & flushes 2023-02-11 19:03:38,978 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:38,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:38,979 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. after waiting 0 ms 2023-02-11 19:03:38,979 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:38,979 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676142212190.c7daa909645d90d5ac028087af882baa. 2023-02-11 19:03:38,979 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c7daa909645d90d5ac028087af882baa: Waiting for close lock at 1676142218978Disabling compacts and flushes for region at 1676142218978Disabling writes for close at 1676142218979 (+1 ms)Writing region close event to WAL at 1676142218979Closed at 1676142218979 2023-02-11 19:03:38,982 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:38,982 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:38,984 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:38,985 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:38,986 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1 2023-02-11 19:03:38,986 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0ef05186abfbad195663be8d73ab9b0 columnFamilyName f1 2023-02-11 19:03:38,988 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:03:38,991 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f1/testWithMapReduce=c0ef05186abfbad195663be8d73ab9b0-418e9190f52444e6af5dbf2b0beb3a36 2023-02-11 19:03:38,992 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(310): Store=c0ef05186abfbad195663be8d73ab9b0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:38,992 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c0ef05186abfbad195663be8d73ab9b0 2023-02-11 19:03:38,993 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2 2023-02-11 19:03:38,993 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0ef05186abfbad195663be8d73ab9b0 columnFamilyName f2 2023-02-11 19:03:39,001 DEBUG [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/c0ef05186abfbad195663be8d73ab9b0/f2/testWithMapReduce=c0ef05186abfbad195663be8d73ab9b0-efb9cbe388fe4b61a1169a28d7199b42 2023-02-11 19:03:39,001 INFO [StoreOpener-c0ef05186abfbad195663be8d73ab9b0-1] regionserver.HStore(310): Store=c0ef05186abfbad195663be8d73ab9b0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:39,001 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c0ef05186abfbad195663be8d73ab9b0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75333574, jitterRate=0.12255772948265076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:39,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c0ef05186abfbad195663be8d73ab9b0: Writing region info on filesystem at 1676142218984Initializing all the Stores at 1676142218985 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218985Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142218985Region opened successfully at 1676142219001 (+16 ms) 2023-02-11 19:03:39,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c0ef05186abfbad195663be8d73ab9b0, disabling compactions & flushes 2023-02-11 19:03:39,031 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:39,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:39,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. after waiting 0 ms 2023-02-11 19:03:39,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:39,035 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676142212190.c0ef05186abfbad195663be8d73ab9b0. 2023-02-11 19:03:39,035 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c0ef05186abfbad195663be8d73ab9b0: Waiting for close lock at 1676142219031Disabling compacts and flushes for region at 1676142219031Disabling writes for close at 1676142219031Writing region close event to WAL at 1676142219035 (+4 ms)Closed at 1676142219035 2023-02-11 19:03:39,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:39,038 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:39,044 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:39,046 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:39,046 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1 2023-02-11 19:03:39,047 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be908093dbb006cd9be0fd4e23662c91 columnFamilyName f1 2023-02-11 19:03:39,051 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f1/testWithMapReduce=be908093dbb006cd9be0fd4e23662c91-faa8f0610ea0444b9f8bbf03326975f3 2023-02-11 19:03:39,052 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(310): Store=be908093dbb006cd9be0fd4e23662c91/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,052 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region be908093dbb006cd9be0fd4e23662c91 2023-02-11 19:03:39,053 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2 2023-02-11 19:03:39,053 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be908093dbb006cd9be0fd4e23662c91 columnFamilyName f2 2023-02-11 19:03:39,060 DEBUG [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/be908093dbb006cd9be0fd4e23662c91/f2/testWithMapReduce=be908093dbb006cd9be0fd4e23662c91-9c02f8bc1ee24e9db63ca4a3dd3d235e 2023-02-11 19:03:39,060 INFO [StoreOpener-be908093dbb006cd9be0fd4e23662c91-1] regionserver.HStore(310): Store=be908093dbb006cd9be0fd4e23662c91/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,060 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:39,060 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened be908093dbb006cd9be0fd4e23662c91; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62537890, jitterRate=-0.0681128203868866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:39,060 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for be908093dbb006cd9be0fd4e23662c91: Writing region info on filesystem at 1676142219044Initializing all the Stores at 1676142219045 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219045Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219045Region opened successfully at 1676142219060 (+15 ms) 2023-02-11 19:03:39,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing be908093dbb006cd9be0fd4e23662c91, disabling compactions & flushes 2023-02-11 19:03:39,090 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:39,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:39,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. after waiting 0 ms 2023-02-11 19:03:39,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:39,091 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676142212190.be908093dbb006cd9be0fd4e23662c91. 2023-02-11 19:03:39,091 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for be908093dbb006cd9be0fd4e23662c91: Waiting for close lock at 1676142219090Disabling compacts and flushes for region at 1676142219090Disabling writes for close at 1676142219090Writing region close event to WAL at 1676142219091 (+1 ms)Closed at 1676142219091 2023-02-11 19:03:39,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:39,093 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:39,094 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:39,096 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:39,097 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1 2023-02-11 19:03:39,097 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1328515bb4b6d89d2e0001e6e49fa12 columnFamilyName f1 2023-02-11 19:03:39,102 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f1/testWithMapReduce=d1328515bb4b6d89d2e0001e6e49fa12-1f911c6d3426452691a3cdce39c13688 2023-02-11 19:03:39,102 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(310): Store=d1328515bb4b6d89d2e0001e6e49fa12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,102 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d1328515bb4b6d89d2e0001e6e49fa12 2023-02-11 19:03:39,103 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2 2023-02-11 19:03:39,104 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1328515bb4b6d89d2e0001e6e49fa12 columnFamilyName f2 2023-02-11 19:03:39,108 DEBUG [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d1328515bb4b6d89d2e0001e6e49fa12/f2/testWithMapReduce=d1328515bb4b6d89d2e0001e6e49fa12-4bc3b4c90b644d3db95946f1a5b5f7aa 2023-02-11 19:03:39,108 INFO [StoreOpener-d1328515bb4b6d89d2e0001e6e49fa12-1] regionserver.HStore(310): Store=d1328515bb4b6d89d2e0001e6e49fa12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:39,109 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d1328515bb4b6d89d2e0001e6e49fa12; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65038482, jitterRate=-0.030851095914840698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:39,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d1328515bb4b6d89d2e0001e6e49fa12: Writing region info on filesystem at 1676142219095Initializing all the Stores at 1676142219095Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219095Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219095Region opened successfully at 1676142219109 (+14 ms) 2023-02-11 19:03:39,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d1328515bb4b6d89d2e0001e6e49fa12, disabling compactions & flushes 2023-02-11 19:03:39,144 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:39,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:39,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. after waiting 0 ms 2023-02-11 19:03:39,144 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:39,145 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676142212190.d1328515bb4b6d89d2e0001e6e49fa12. 2023-02-11 19:03:39,145 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d1328515bb4b6d89d2e0001e6e49fa12: Waiting for close lock at 1676142219144Disabling compacts and flushes for region at 1676142219144Disabling writes for close at 1676142219144Writing region close event to WAL at 1676142219145 (+1 ms)Closed at 1676142219145 2023-02-11 19:03:39,148 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:39,148 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:39,149 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:39,151 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:39,151 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1 2023-02-11 19:03:39,152 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19369f1367219909e3dd22efe0bb708 columnFamilyName f1 2023-02-11 19:03:39,156 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f1/testWithMapReduce=d19369f1367219909e3dd22efe0bb708-42959f4102884fe8b0901a74adca2e57 2023-02-11 19:03:39,156 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(310): Store=d19369f1367219909e3dd22efe0bb708/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,157 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d19369f1367219909e3dd22efe0bb708 2023-02-11 19:03:39,157 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2 2023-02-11 19:03:39,158 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19369f1367219909e3dd22efe0bb708 columnFamilyName f2 2023-02-11 19:03:39,162 DEBUG [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(539): loaded hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/d19369f1367219909e3dd22efe0bb708/f2/testWithMapReduce=d19369f1367219909e3dd22efe0bb708-19f26747615f403aa7d74143ac402a63 2023-02-11 19:03:39,162 INFO [StoreOpener-d19369f1367219909e3dd22efe0bb708-1] regionserver.HStore(310): Store=d19369f1367219909e3dd22efe0bb708/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:39,162 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d19369f1367219909e3dd22efe0bb708; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58889989, jitterRate=-0.12247078120708466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:39,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d19369f1367219909e3dd22efe0bb708: Writing region info on filesystem at 1676142219149Initializing all the Stores at 1676142219150 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219150Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219150Region opened successfully at 1676142219162 (+12 ms) 2023-02-11 19:03:39,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d19369f1367219909e3dd22efe0bb708, disabling compactions & flushes 2023-02-11 19:03:39,189 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:39,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:39,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. after waiting 0 ms 2023-02-11 19:03:39,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:39,190 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676142212190.d19369f1367219909e3dd22efe0bb708. 2023-02-11 19:03:39,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d19369f1367219909e3dd22efe0bb708: Waiting for close lock at 1676142219189Disabling compacts and flushes for region at 1676142219189Disabling writes for close at 1676142219190 (+1 ms)Writing region close event to WAL at 1676142219190Closed at 1676142219190 2023-02-11 19:03:39,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:39,193 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:39,199 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:39,202 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:39,203 DEBUG [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/f1 2023-02-11 19:03:39,204 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de0005f8ed15524083f68c4a7bfdd603 columnFamilyName f1 2023-02-11 19:03:39,204 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(310): Store=de0005f8ed15524083f68c4a7bfdd603/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,204 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de0005f8ed15524083f68c4a7bfdd603 2023-02-11 19:03:39,205 DEBUG [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33995/user/jenkins/test-data/df5d0619-e4e0-b364-3ef3-01038bf93dfa/testWithMapReduceAndOfflineHBaseMultiRegion/509d6a12-78ef-427e-be79-273a9ae8550c/data/default/testWithMapReduce/de0005f8ed15524083f68c4a7bfdd603/f2 2023-02-11 19:03:39,205 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de0005f8ed15524083f68c4a7bfdd603 columnFamilyName f2 2023-02-11 19:03:39,206 INFO [StoreOpener-de0005f8ed15524083f68c4a7bfdd603-1] regionserver.HStore(310): Store=de0005f8ed15524083f68c4a7bfdd603/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:39,206 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:39,207 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened de0005f8ed15524083f68c4a7bfdd603; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68443353, jitterRate=0.019885435700416565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:39,207 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for de0005f8ed15524083f68c4a7bfdd603: Writing region info on filesystem at 1676142219199Initializing all the Stores at 1676142219200 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219200Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142219200Region opened successfully at 1676142219207 (+7 ms) 2023-02-11 19:03:39,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing de0005f8ed15524083f68c4a7bfdd603, disabling compactions & flushes 2023-02-11 19:03:39,225 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:39,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:39,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. after waiting 0 ms 2023-02-11 19:03:39,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:39,225 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142212190.de0005f8ed15524083f68c4a7bfdd603. 2023-02-11 19:03:39,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for de0005f8ed15524083f68c4a7bfdd603: Waiting for close lock at 1676142219225Disabling compacts and flushes for region at 1676142219225Disabling writes for close at 1676142219225Writing region close event to WAL at 1676142219225Closed at 1676142219225 2023-02-11 19:03:39,735 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:03:39,735 WARN [Listener at localhost/34971] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:39,737 INFO [Listener at localhost/34971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:39,841 WARN [BP-925946209-172.31.14.131-1676142209899 heartbeating to localhost/127.0.0.1:33995] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:39,841 WARN [BP-925946209-172.31.14.131-1676142209899 heartbeating to localhost/127.0.0.1:33995] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-925946209-172.31.14.131-1676142209899 (Datanode Uuid b5592239-aaa1-4287-89c6-3fb814bbf783) service to localhost/127.0.0.1:33995 2023-02-11 19:03:39,841 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/dfs/data/data3/current/BP-925946209-172.31.14.131-1676142209899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:39,842 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/dfs/data/data4/current/BP-925946209-172.31.14.131-1676142209899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:39,842 WARN [Listener at localhost/34971] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:39,845 INFO [Listener at localhost/34971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:39,949 WARN [BP-925946209-172.31.14.131-1676142209899 heartbeating to localhost/127.0.0.1:33995] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:39,950 WARN [BP-925946209-172.31.14.131-1676142209899 heartbeating to localhost/127.0.0.1:33995] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-925946209-172.31.14.131-1676142209899 (Datanode Uuid 0b8f4d0d-782b-4acf-9111-c0c1c38a0704) service to localhost/127.0.0.1:33995 2023-02-11 19:03:39,950 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/dfs/data/data1/current/BP-925946209-172.31.14.131-1676142209899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:39,951 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/cluster_b8f8f295-e820-8724-12fd-7a9c03239a7e/dfs/data/data2/current/BP-925946209-172.31.14.131-1676142209899] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:39,962 INFO [Listener at localhost/34971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:40,089 INFO [Listener at localhost/34971] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:03:40,134 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:03:40,147 INFO [Listener at localhost/34971] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 104) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33995 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33995 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:33995 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33995 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33995 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38695,1676142210691)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:33995 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33995 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34971 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=544 (was 545), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 293), ProcessCount=167 (was 167), AvailableMemoryMB=4028 (was 4194) 2023-02-11 19:03:40,156 INFO [Listener at localhost/34971] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=544, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=167, AvailableMemoryMB=4028 2023-02-11 19:03:40,167 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop.log.dir so I do NOT create it in target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490 2023-02-11 19:03:40,168 WARN [Listener at localhost/34971] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop.tmp.dir so I do NOT create it in target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490 2023-02-11 19:03:40,168 WARN [Listener at localhost/34971] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ca19e9-be6c-8865-8621-9546e036b030/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 19:03:40,168 DEBUG [Listener at localhost/34971] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e, deleteOnExit=true 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/test.cache.data in system properties and HBase conf 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:03:40,168 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:03:40,169 DEBUG [Listener at localhost/34971] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:03:40,169 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:03:40,170 INFO [Listener at localhost/34971] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:03:40,174 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:40,174 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:40,217 WARN [Listener at localhost/34971] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:40,219 INFO [Listener at localhost/34971] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:40,225 INFO [Listener at localhost/34971] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/java.io.tmpdir/Jetty_localhost_34955_hdfs____.k2nyda/webapp 2023-02-11 19:03:40,317 INFO [Listener at localhost/34971] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34955 2023-02-11 19:03:40,322 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:40,322 WARN [Listener at localhost/34971] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:40,368 WARN [Listener at localhost/40967] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:40,379 WARN [Listener at localhost/40967] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:40,381 WARN [Listener at localhost/40967] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:40,382 INFO [Listener at localhost/40967] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:40,387 INFO [Listener at localhost/40967] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/java.io.tmpdir/Jetty_localhost_37825_datanode____j3ipdq/webapp 2023-02-11 19:03:40,480 INFO [Listener at localhost/40967] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37825 2023-02-11 19:03:40,488 WARN [Listener at localhost/43553] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:40,504 WARN [Listener at localhost/43553] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:40,506 WARN [Listener at localhost/43553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:40,508 INFO [Listener at localhost/43553] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:40,513 INFO [Listener at localhost/43553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/java.io.tmpdir/Jetty_localhost_41881_datanode____.9ncscl/webapp 2023-02-11 19:03:40,587 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc01a44f5a1570ac6: Processing first storage report for DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3 from datanode 2222ae78-c0ae-42e3-b3bc-b31720afce3e 2023-02-11 19:03:40,587 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc01a44f5a1570ac6: from storage DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3 node DatanodeRegistration(127.0.0.1:37565, datanodeUuid=2222ae78-c0ae-42e3-b3bc-b31720afce3e, infoPort=45473, infoSecurePort=0, ipcPort=43553, storageInfo=lv=-57;cid=testClusterID;nsid=323715731;c=1676142220177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:40,587 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc01a44f5a1570ac6: Processing first storage report for DS-e603636e-cba9-4548-85a9-17999b239f4d from datanode 2222ae78-c0ae-42e3-b3bc-b31720afce3e 2023-02-11 19:03:40,587 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc01a44f5a1570ac6: from storage DS-e603636e-cba9-4548-85a9-17999b239f4d node DatanodeRegistration(127.0.0.1:37565, datanodeUuid=2222ae78-c0ae-42e3-b3bc-b31720afce3e, infoPort=45473, infoSecurePort=0, ipcPort=43553, storageInfo=lv=-57;cid=testClusterID;nsid=323715731;c=1676142220177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:40,612 INFO [Listener at localhost/43553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41881 2023-02-11 19:03:40,619 WARN [Listener at localhost/35005] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:40,711 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x839fb7271df01d4a: Processing first storage report for DS-bd51001f-5cda-45f5-826a-4b928b1304c9 from datanode cdc3c2c2-fad5-40d7-b0c1-1f25f50d1003 2023-02-11 19:03:40,711 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x839fb7271df01d4a: from storage DS-bd51001f-5cda-45f5-826a-4b928b1304c9 node DatanodeRegistration(127.0.0.1:32789, datanodeUuid=cdc3c2c2-fad5-40d7-b0c1-1f25f50d1003, infoPort=37855, infoSecurePort=0, ipcPort=35005, storageInfo=lv=-57;cid=testClusterID;nsid=323715731;c=1676142220177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:40,711 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x839fb7271df01d4a: Processing first storage report for DS-80b22f3c-c5e8-44f3-bdba-fcdf67a06277 from datanode cdc3c2c2-fad5-40d7-b0c1-1f25f50d1003 2023-02-11 19:03:40,711 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x839fb7271df01d4a: from storage DS-80b22f3c-c5e8-44f3-bdba-fcdf67a06277 node DatanodeRegistration(127.0.0.1:32789, datanodeUuid=cdc3c2c2-fad5-40d7-b0c1-1f25f50d1003, infoPort=37855, infoSecurePort=0, ipcPort=35005, storageInfo=lv=-57;cid=testClusterID;nsid=323715731;c=1676142220177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:40,729 DEBUG [Listener at localhost/35005] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490 2023-02-11 19:03:40,732 INFO [Listener at localhost/35005] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/zookeeper_0, clientPort=53692, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:03:40,733 INFO [Listener at localhost/35005] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53692 2023-02-11 19:03:40,733 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,734 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,745 INFO [Listener at localhost/35005] util.FSUtils(479): Created version file at hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1 with version=8 2023-02-11 19:03:40,745 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,746 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,747 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40967/user/jenkins/test-data/ac990c4c-0d52-816f-4b2c-75ed8b643b42/hbase-staging 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:40,749 INFO [Listener at localhost/35005] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:40,750 INFO [Listener at localhost/35005] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43213 2023-02-11 19:03:40,751 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,752 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,752 INFO [Listener at localhost/35005] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43213 connecting to ZooKeeper ensemble=127.0.0.1:53692 2023-02-11 19:03:40,760 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:432130x0, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:40,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43213-0x10044c47f7f0000 connected 2023-02-11 19:03:40,777 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:40,778 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:40,778 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:40,780 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43213 2023-02-11 19:03:40,780 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43213 2023-02-11 19:03:40,780 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43213 2023-02-11 19:03:40,784 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43213 2023-02-11 19:03:40,784 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43213 2023-02-11 19:03:40,784 INFO [Listener at localhost/35005] master.HMaster(439): hbase.rootdir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1, hbase.cluster.distributed=false 2023-02-11 19:03:40,796 INFO [Listener at localhost/35005] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:40,796 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,797 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,797 INFO [Listener at localhost/35005] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:40,797 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,797 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:40,797 INFO [Listener at localhost/35005] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:40,799 INFO [Listener at localhost/35005] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38445 2023-02-11 19:03:40,799 INFO [Listener at localhost/35005] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:40,804 DEBUG [Listener at localhost/35005] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:40,805 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,806 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,806 INFO [Listener at localhost/35005] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38445 connecting to ZooKeeper ensemble=127.0.0.1:53692 2023-02-11 19:03:40,809 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:384450x0, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:40,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38445-0x10044c47f7f0001 connected 2023-02-11 19:03:40,811 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:40,812 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:40,813 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:40,815 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38445 2023-02-11 19:03:40,816 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38445 2023-02-11 19:03:40,816 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38445 2023-02-11 19:03:40,817 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38445 2023-02-11 19:03:40,820 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38445 2023-02-11 19:03:40,830 INFO [Listener at localhost/35005] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:40,831 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,831 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,831 INFO [Listener at localhost/35005] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:40,831 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:40,831 INFO [Listener at localhost/35005] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:40,831 INFO [Listener at localhost/35005] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:40,834 INFO [Listener at localhost/35005] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34507 2023-02-11 19:03:40,834 INFO [Listener at localhost/35005] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:40,835 DEBUG [Listener at localhost/35005] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:40,836 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,837 INFO [Listener at localhost/35005] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,837 INFO [Listener at localhost/35005] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34507 connecting to ZooKeeper ensemble=127.0.0.1:53692 2023-02-11 19:03:40,841 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:345070x0, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:40,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34507-0x10044c47f7f0002 connected 2023-02-11 19:03:40,844 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:40,845 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:40,845 DEBUG [Listener at localhost/35005] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:40,849 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34507 2023-02-11 19:03:40,849 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34507 2023-02-11 19:03:40,852 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34507 2023-02-11 19:03:40,852 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34507 2023-02-11 19:03:40,852 DEBUG [Listener at localhost/35005] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34507 2023-02-11 19:03:40,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,855 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:40,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,861 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:40,861 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:40,861 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:40,861 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:40,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:40,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43213,1676142220748 from backup master directory 2023-02-11 19:03:40,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:40,864 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,864 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:40,864 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:40,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/hbase.id with ID: 0159bf17-207b-4f95-a42d-74659f29f668 2023-02-11 19:03:40,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:40,888 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:40,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1e68a975 to 127.0.0.1:53692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:40,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1beada60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:40,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:40,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:03:40,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:40,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store-tmp 2023-02-11 19:03:40,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:40,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:40,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:40,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:40,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:40,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:40,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:40,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142220913Disabling compacts and flushes for region at 1676142220913Disabling writes for close at 1676142220914 (+1 ms)Writing region close event to WAL at 1676142220914Closed at 1676142220914 2023-02-11 19:03:40,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/WALs/jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43213%2C1676142220748, suffix=, logDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/WALs/jenkins-hbase4.apache.org,43213,1676142220748, archiveDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/oldWALs, maxLogs=10 2023-02-11 19:03:40,931 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK] 2023-02-11 19:03:40,931 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK] 2023-02-11 19:03:40,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/WALs/jenkins-hbase4.apache.org,43213,1676142220748/jenkins-hbase4.apache.org%2C43213%2C1676142220748.1676142220917 2023-02-11 19:03:40,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK], DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK]] 2023-02-11 19:03:40,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:40,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:40,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:40,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:40,939 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:40,940 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:03:40,941 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:03:40,941 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:40,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:40,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:40,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:40,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:40,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64110455, jitterRate=-0.04467977583408356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:40,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142220938Initializing all the Stores at 1676142220939 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142220939Cleaning up temporary data from old regions at 1676142220943 (+4 ms)Cleaning up detritus from prior splits at 1676142220943Region opened successfully at 1676142220949 (+6 ms) 2023-02-11 19:03:40,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:03:40,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:03:40,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:03:40,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:03:40,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 19:03:40,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 19:03:40,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:03:40,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:03:40,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:03:40,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:03:40,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:03:40,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:03:40,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:03:40,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:03:40,966 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:40,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:03:40,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:03:40,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:03:40,969 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:40,969 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:40,969 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:40,969 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:40,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43213,1676142220748, sessionid=0x10044c47f7f0000, setting cluster-up flag (Was=false) 2023-02-11 19:03:40,974 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:40,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:03:40,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,983 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:40,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:03:40,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:40,987 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.hbase-snapshot/.tmp 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:40,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142250993 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:03:40,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:40,993 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:40,994 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:03:40,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:03:40,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:03:40,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:03:40,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:03:40,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:03:40,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142220994,5,FailOnTimeoutGroup] 2023-02-11 19:03:40,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142220994,5,FailOnTimeoutGroup] 2023-02-11 19:03:40,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:40,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:03:40,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:40,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:40,995 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:41,009 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:41,009 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:41,009 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1 2023-02-11 19:03:41,020 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:41,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:41,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/info 2023-02-11 19:03:41,022 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:41,023 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,023 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:41,024 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:41,024 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:41,025 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,025 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:41,026 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/table 2023-02-11 19:03:41,026 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:41,026 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,027 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740 2023-02-11 19:03:41,027 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740 2023-02-11 19:03:41,029 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:41,030 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:41,031 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:41,032 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63827834, jitterRate=-0.048891156911849976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:41,032 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142221020Initializing all the Stores at 1676142221020Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142221021 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142221021Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142221021Cleaning up temporary data from old regions at 1676142221028 (+7 ms)Cleaning up detritus from prior splits at 1676142221028Region opened successfully at 1676142221032 (+4 ms) 2023-02-11 19:03:41,032 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:41,032 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:41,032 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:41,032 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:41,032 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:41,032 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:41,032 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142221032Disabling compacts and flushes for region at 1676142221032Disabling writes for close at 1676142221032Writing region close event to WAL at 1676142221032Closed at 1676142221032 2023-02-11 19:03:41,033 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:41,033 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:03:41,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:03:41,035 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:03:41,036 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:03:41,054 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(952): ClusterId : 0159bf17-207b-4f95-a42d-74659f29f668 2023-02-11 19:03:41,054 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(952): ClusterId : 0159bf17-207b-4f95-a42d-74659f29f668 2023-02-11 19:03:41,054 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:41,054 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:41,057 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:41,058 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:41,057 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:41,058 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:41,060 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:41,061 DEBUG [RS:1;jenkins-hbase4:34507] zookeeper.ReadOnlyZKClient(139): Connect 0x68101460 to 127.0.0.1:53692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:41,061 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:41,062 DEBUG [RS:0;jenkins-hbase4:38445] zookeeper.ReadOnlyZKClient(139): Connect 0x4c4e4cb2 to 127.0.0.1:53692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:41,071 DEBUG [RS:1;jenkins-hbase4:34507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d7e712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:41,071 DEBUG [RS:1;jenkins-hbase4:34507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62e87f10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:41,071 DEBUG [RS:0;jenkins-hbase4:38445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4289bb4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:41,071 DEBUG [RS:0;jenkins-hbase4:38445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46b627c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:41,085 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34507 2023-02-11 19:03:41,085 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38445 2023-02-11 19:03:41,085 INFO [RS:1;jenkins-hbase4:34507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:41,085 INFO [RS:1;jenkins-hbase4:34507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:41,085 INFO [RS:0;jenkins-hbase4:38445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:41,085 INFO [RS:0;jenkins-hbase4:38445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:41,085 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:41,085 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:41,086 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43213,1676142220748 with isa=jenkins-hbase4.apache.org/172.31.14.131:38445, startcode=1676142220796 2023-02-11 19:03:41,086 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43213,1676142220748 with isa=jenkins-hbase4.apache.org/172.31.14.131:34507, startcode=1676142220830 2023-02-11 19:03:41,087 DEBUG [RS:1;jenkins-hbase4:34507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:41,087 DEBUG [RS:0;jenkins-hbase4:38445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:41,089 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58103, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:41,090 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42429, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:41,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43213] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,092 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1 2023-02-11 19:03:41,092 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1 2023-02-11 19:03:41,092 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40967 2023-02-11 19:03:41,092 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40967 2023-02-11 19:03:41,092 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:41,092 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:41,096 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:41,096 DEBUG [RS:0;jenkins-hbase4:38445] zookeeper.ZKUtil(162): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,096 DEBUG [RS:1;jenkins-hbase4:34507] zookeeper.ZKUtil(162): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,097 WARN [RS:0;jenkins-hbase4:38445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:41,097 WARN [RS:1;jenkins-hbase4:34507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:41,097 INFO [RS:0;jenkins-hbase4:38445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:41,097 INFO [RS:1;jenkins-hbase4:34507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:41,097 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,097 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34507,1676142220830] 2023-02-11 19:03:41,097 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38445,1676142220796] 2023-02-11 19:03:41,097 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,101 DEBUG [RS:1;jenkins-hbase4:34507] zookeeper.ZKUtil(162): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,101 DEBUG [RS:0;jenkins-hbase4:38445] zookeeper.ZKUtil(162): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,102 DEBUG [RS:1;jenkins-hbase4:34507] zookeeper.ZKUtil(162): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,102 DEBUG [RS:0;jenkins-hbase4:38445] zookeeper.ZKUtil(162): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,102 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:41,102 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:41,103 INFO [RS:1;jenkins-hbase4:34507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:41,103 INFO [RS:0;jenkins-hbase4:38445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:41,104 INFO [RS:1;jenkins-hbase4:34507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:41,107 INFO [RS:1;jenkins-hbase4:34507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:41,107 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,107 INFO [RS:0;jenkins-hbase4:38445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:41,107 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:41,108 INFO [RS:0;jenkins-hbase4:38445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:41,108 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,108 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:41,108 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,109 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,109 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:1;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,110 DEBUG [RS:0;jenkins-hbase4:38445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:41,113 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,113 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,113 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,113 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,113 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,113 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,127 INFO [RS:1;jenkins-hbase4:34507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:41,127 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34507,1676142220830-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,130 INFO [RS:0;jenkins-hbase4:38445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:41,130 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38445,1676142220796-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,138 INFO [RS:1;jenkins-hbase4:34507] regionserver.Replication(203): jenkins-hbase4.apache.org,34507,1676142220830 started 2023-02-11 19:03:41,138 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34507,1676142220830, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34507, sessionid=0x10044c47f7f0002 2023-02-11 19:03:41,138 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:41,138 DEBUG [RS:1;jenkins-hbase4:34507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,138 DEBUG [RS:1;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34507,1676142220830' 2023-02-11 19:03:41,138 DEBUG [RS:1;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:41,138 DEBUG [RS:1;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34507,1676142220830' 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:41,139 DEBUG [RS:1;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:41,139 INFO [RS:1;jenkins-hbase4:34507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:41,139 INFO [RS:1;jenkins-hbase4:34507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:41,140 INFO [RS:0;jenkins-hbase4:38445] regionserver.Replication(203): jenkins-hbase4.apache.org,38445,1676142220796 started 2023-02-11 19:03:41,140 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38445,1676142220796, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38445, sessionid=0x10044c47f7f0001 2023-02-11 19:03:41,140 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:41,140 DEBUG [RS:0;jenkins-hbase4:38445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,140 DEBUG [RS:0;jenkins-hbase4:38445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38445,1676142220796' 2023-02-11 19:03:41,140 DEBUG [RS:0;jenkins-hbase4:38445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38445,1676142220796' 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:41,141 DEBUG [RS:0;jenkins-hbase4:38445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:41,141 INFO [RS:0;jenkins-hbase4:38445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:41,141 INFO [RS:0;jenkins-hbase4:38445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:41,187 DEBUG [jenkins-hbase4:43213] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:03:41,187 DEBUG [jenkins-hbase4:43213] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:41,188 DEBUG [jenkins-hbase4:43213] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:41,188 DEBUG [jenkins-hbase4:43213] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:41,188 DEBUG [jenkins-hbase4:43213] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:41,189 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34507,1676142220830, state=OPENING 2023-02-11 19:03:41,191 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:03:41,193 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:41,193 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:41,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34507,1676142220830}] 2023-02-11 19:03:41,347 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:41,347 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:41,349 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:41,353 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:03:41,353 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:41,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34507%2C1676142220830.meta, suffix=.meta, logDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,34507,1676142220830, archiveDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/oldWALs, maxLogs=32 2023-02-11 19:03:41,369 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK] 2023-02-11 19:03:41,370 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK] 2023-02-11 19:03:41,371 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,34507,1676142220830/jenkins-hbase4.apache.org%2C34507%2C1676142220830.meta.1676142221355.meta 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK], DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK]] 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:03:41,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:03:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:03:41,374 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:41,375 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/info 2023-02-11 19:03:41,375 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/info 2023-02-11 19:03:41,375 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:41,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:41,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:41,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:41,377 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:41,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:41,379 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/table 2023-02-11 19:03:41,379 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/table 2023-02-11 19:03:41,379 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:41,379 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740 2023-02-11 19:03:41,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740 2023-02-11 19:03:41,383 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:41,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:41,384 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63600711, jitterRate=-0.05227555334568024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:41,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142221373Writing region info on filesystem at 1676142221373Initializing all the Stores at 1676142221373Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142221373Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142221374 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142221374Cleaning up temporary data from old regions at 1676142221382 (+8 ms)Cleaning up detritus from prior splits at 1676142221382Running coprocessor post-open hooks at 1676142221384 (+2 ms)Region opened successfully at 1676142221384 2023-02-11 19:03:41,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142221347 2023-02-11 19:03:41,388 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:03:41,389 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:03:41,389 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34507,1676142220830, state=OPEN 2023-02-11 19:03:41,391 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:03:41,391 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:41,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:03:41,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34507,1676142220830 in 198 msec 2023-02-11 19:03:41,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:03:41,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-11 19:03:41,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 406 msec 2023-02-11 19:03:41,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142220855, completionTime=-1 2023-02-11 19:03:41,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:03:41,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:03:41,398 DEBUG [hconnection-0x645e5532-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:41,399 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57626, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:41,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:03:41,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142281400 2023-02-11 19:03:41,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142341400 2023-02-11 19:03:41,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43213,1676142220748-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43213,1676142220748-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43213,1676142220748-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43213, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:03:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:41,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:03:41,410 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:03:41,410 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:41,411 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:41,412 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,413 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca empty. 2023-02-11 19:03:41,413 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,413 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:03:41,422 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:41,424 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d0ef3356dbfe9e507d350e809c4d63ca, NAME => 'hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp 2023-02-11 19:03:41,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:41,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d0ef3356dbfe9e507d350e809c4d63ca, disabling compactions & flushes 2023-02-11 19:03:41,433 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. after waiting 0 ms 2023-02-11 19:03:41,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,433 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,433 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d0ef3356dbfe9e507d350e809c4d63ca: Waiting for close lock at 1676142221433Disabling compacts and flushes for region at 1676142221433Disabling writes for close at 1676142221433Writing region close event to WAL at 1676142221433Closed at 1676142221433 2023-02-11 19:03:41,435 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:41,436 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142221436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142221436"}]},"ts":"1676142221436"} 2023-02-11 19:03:41,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:41,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:41,439 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142221439"}]},"ts":"1676142221439"} 2023-02-11 19:03:41,440 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:03:41,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:41,445 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:41,445 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:41,445 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:41,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d0ef3356dbfe9e507d350e809c4d63ca, ASSIGN}] 2023-02-11 19:03:41,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d0ef3356dbfe9e507d350e809c4d63ca, ASSIGN 2023-02-11 19:03:41,448 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d0ef3356dbfe9e507d350e809c4d63ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38445,1676142220796; forceNewPlan=false, retain=false 2023-02-11 19:03:41,599 INFO [jenkins-hbase4:43213] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:41,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d0ef3356dbfe9e507d350e809c4d63ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142221600"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142221600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142221600"}]},"ts":"1676142221600"} 2023-02-11 19:03:41,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d0ef3356dbfe9e507d350e809c4d63ca, server=jenkins-hbase4.apache.org,38445,1676142220796}] 2023-02-11 19:03:41,754 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,754 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:41,756 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:41,760 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,761 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38445%2C1676142220796, suffix=, logDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,38445,1676142220796, archiveDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/oldWALs, maxLogs=32 2023-02-11 19:03:41,776 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK] 2023-02-11 19:03:41,776 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK] 2023-02-11 19:03:41,778 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,38445,1676142220796/jenkins-hbase4.apache.org%2C38445%2C1676142220796.1676142221762 2023-02-11 19:03:41,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK], DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK]] 2023-02-11 19:03:41,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d0ef3356dbfe9e507d350e809c4d63ca, NAME => 'hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:41,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:41,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,780 INFO [StoreOpener-d0ef3356dbfe9e507d350e809c4d63ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,781 DEBUG [StoreOpener-d0ef3356dbfe9e507d350e809c4d63ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/info 2023-02-11 19:03:41,781 DEBUG [StoreOpener-d0ef3356dbfe9e507d350e809c4d63ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/info 2023-02-11 19:03:41,781 INFO [StoreOpener-d0ef3356dbfe9e507d350e809c4d63ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ef3356dbfe9e507d350e809c4d63ca columnFamilyName info 2023-02-11 19:03:41,782 INFO [StoreOpener-d0ef3356dbfe9e507d350e809c4d63ca-1] regionserver.HStore(310): Store=d0ef3356dbfe9e507d350e809c4d63ca/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:41,782 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,783 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,785 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:41,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:41,787 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d0ef3356dbfe9e507d350e809c4d63ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59798583, jitterRate=-0.10893167555332184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:41,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d0ef3356dbfe9e507d350e809c4d63ca: Running coprocessor pre-open hook at 1676142221779Writing region info on filesystem at 1676142221779Initializing all the Stores at 1676142221780 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142221780Cleaning up temporary data from old regions at 1676142221783 (+3 ms)Cleaning up detritus from prior splits at 1676142221783Running coprocessor post-open hooks at 1676142221787 (+4 ms)Region opened successfully at 1676142221787 2023-02-11 19:03:41,788 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca., pid=6, masterSystemTime=1676142221754 2023-02-11 19:03:41,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,791 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:41,791 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d0ef3356dbfe9e507d350e809c4d63ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:41,792 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142221791"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142221791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142221791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142221791"}]},"ts":"1676142221791"} 2023-02-11 19:03:41,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:03:41,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d0ef3356dbfe9e507d350e809c4d63ca, server=jenkins-hbase4.apache.org,38445,1676142220796 in 191 msec 2023-02-11 19:03:41,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:03:41,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d0ef3356dbfe9e507d350e809c4d63ca, ASSIGN in 350 msec 2023-02-11 19:03:41,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:41,797 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142221797"}]},"ts":"1676142221797"} 2023-02-11 19:03:41,799 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:03:41,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:41,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 393 msec 2023-02-11 19:03:41,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:03:41,811 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:41,811 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:41,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:41,815 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:41,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:03:41,826 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:41,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-11 19:03:41,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:03:41,863 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:41,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 28 msec 2023-02-11 19:03:41,887 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:03:41,889 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:03:41,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.025sec 2023-02-11 19:03:41,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:03:41,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:03:41,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:03:41,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43213,1676142220748-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:03:41,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43213,1676142220748-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:03:41,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:03:41,955 DEBUG [Listener at localhost/35005] zookeeper.ReadOnlyZKClient(139): Connect 0x7f17c9fa to 127.0.0.1:53692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:41,961 DEBUG [Listener at localhost/35005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e472ffe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:41,962 DEBUG [hconnection-0x3eca5a29-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:41,965 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57628, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:41,966 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:41,966 DEBUG [Listener at localhost/35005] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:03:41,969 DEBUG [Listener at localhost/35005] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:03:41,970 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58042, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:03:41,971 INFO [Listener at localhost/35005] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:41,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:41,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:03:41,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:58042 deadline: 1676142281971, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:41,972 INFO [Listener at localhost/35005] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-11 19:03:41,974 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:41,976 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:41,977 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-11 19:03:41,977 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:41,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:41,979 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:41,979 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee empty. 2023-02-11 19:03:41,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:41,980 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-11 19:03:41,995 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:41,996 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd429014cd17d04d1f60f9eca39086ee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp 2023-02-11 19:03:42,006 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:42,006 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing cd429014cd17d04d1f60f9eca39086ee, disabling compactions & flushes 2023-02-11 19:03:42,006 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,006 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,006 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. after waiting 0 ms 2023-02-11 19:03:42,006 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,006 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,007 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for cd429014cd17d04d1f60f9eca39086ee: Waiting for close lock at 1676142222006Disabling compacts and flushes for region at 1676142222006Disabling writes for close at 1676142222006Writing region close event to WAL at 1676142222006Closed at 1676142222006 2023-02-11 19:03:42,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:42,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676142222009"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142222009"}]},"ts":"1676142222009"} 2023-02-11 19:03:42,011 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:42,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:42,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142222012"}]},"ts":"1676142222012"} 2023-02-11 19:03:42,013 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-11 19:03:42,016 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:42,017 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:42,017 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:42,017 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:42,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, ASSIGN}] 2023-02-11 19:03:42,019 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, ASSIGN 2023-02-11 19:03:42,020 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34507,1676142220830; forceNewPlan=false, retain=false 2023-02-11 19:03:42,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:42,142 INFO [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34507%2C1676142220830, suffix=, logDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,34507,1676142220830, archiveDir=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/oldWALs, maxLogs=32 2023-02-11 19:03:42,156 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK] 2023-02-11 19:03:42,156 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK] 2023-02-11 19:03:42,158 INFO [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,34507,1676142220830/jenkins-hbase4.apache.org%2C34507%2C1676142220830.1676142222142 2023-02-11 19:03:42,158 DEBUG [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32789,DS-bd51001f-5cda-45f5-826a-4b928b1304c9,DISK], DatanodeInfoWithStorage[127.0.0.1:37565,DS-1f38af60-e6ad-412e-893d-af7fb1fa18b3,DISK]] 2023-02-11 19:03:42,170 INFO [jenkins-hbase4:43213] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:42,171 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cd429014cd17d04d1f60f9eca39086ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,171 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676142222171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142222171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142222171"}]},"ts":"1676142222171"} 2023-02-11 19:03:42,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure cd429014cd17d04d1f60f9eca39086ee, server=jenkins-hbase4.apache.org,34507,1676142220830}] 2023-02-11 19:03:42,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:42,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cd429014cd17d04d1f60f9eca39086ee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:42,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:42,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,330 INFO [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,331 DEBUG [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1 2023-02-11 19:03:42,332 DEBUG [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1 2023-02-11 19:03:42,332 INFO [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd429014cd17d04d1f60f9eca39086ee columnFamilyName f1 2023-02-11 19:03:42,333 INFO [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] regionserver.HStore(310): Store=cd429014cd17d04d1f60f9eca39086ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:42,333 INFO [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,334 DEBUG [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2 2023-02-11 19:03:42,334 DEBUG [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2 2023-02-11 19:03:42,334 INFO [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd429014cd17d04d1f60f9eca39086ee columnFamilyName f2 2023-02-11 19:03:42,335 INFO [StoreOpener-cd429014cd17d04d1f60f9eca39086ee-1] regionserver.HStore(310): Store=cd429014cd17d04d1f60f9eca39086ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:42,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:42,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:42,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:42,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cd429014cd17d04d1f60f9eca39086ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60392606, jitterRate=-0.10008004307746887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:42,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cd429014cd17d04d1f60f9eca39086ee: Running coprocessor pre-open hook at 1676142222329Writing region info on filesystem at 1676142222329Initializing all the Stores at 1676142222330 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142222330Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142222330Cleaning up temporary data from old regions at 1676142222337 (+7 ms)Cleaning up detritus from prior splits at 1676142222337Running coprocessor post-open hooks at 1676142222373 (+36 ms)Region opened successfully at 1676142222373 2023-02-11 19:03:42,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee., pid=12, masterSystemTime=1676142222324 2023-02-11 19:03:42,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,376 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cd429014cd17d04d1f60f9eca39086ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,377 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676142222376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142222376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142222376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142222376"}]},"ts":"1676142222376"} 2023-02-11 19:03:42,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 19:03:42,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure cd429014cd17d04d1f60f9eca39086ee, server=jenkins-hbase4.apache.org,34507,1676142220830 in 205 msec 2023-02-11 19:03:42,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 19:03:42,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, ASSIGN in 362 msec 2023-02-11 19:03:42,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:42,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142222382"}]},"ts":"1676142222382"} 2023-02-11 19:03:42,383 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-11 19:03:42,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:42,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 411 msec 2023-02-11 19:03:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:42,583 INFO [Listener at localhost/35005] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-11 19:03:42,583 DEBUG [Listener at localhost/35005] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-11 19:03:42,583 INFO [Listener at localhost/35005] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:42,585 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-11 19:03:42,586 INFO [Listener at localhost/35005] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:42,586 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-11 19:03:42,586 INFO [Listener at localhost/35005] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:03:42,623 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34507] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,740 INFO [Listener at localhost/35005] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:03:42,740 INFO [Listener at localhost/35005] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:03:42,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 19:03:42,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142222743 (current time:1676142222743). 2023-02-11 19:03:42,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:03:42,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] zookeeper.ReadOnlyZKClient(139): Connect 0x30a2463e to 127.0.0.1:53692 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:42,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eecf72b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:42,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:42,753 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:42,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30a2463e to 127.0.0.1:53692 2023-02-11 19:03:42,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:42,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:03:42,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 19:03:42,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 19:03:42,758 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 19:03:42,759 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676142822759 2023-02-11 19:03:42,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 19:03:42,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:42,760 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:42,760 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:03:42,761 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 19:03:42,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 19:03:42,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-11 19:03:42,763 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 19:03:42,764 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676142822764 2023-02-11 19:03:42,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-11 19:03:42,778 INFO [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-11 19:03:42,778 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:42,779 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-11 19:03:42,779 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-11 19:03:42,779 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,779 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,781 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:42,781 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:42,781 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:42,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:42,781 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,781 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-11 19:03:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-11 19:03:42,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 19:03:42,784 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 19:03:42,784 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:42,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,785 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 19:03:42,785 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 19:03:42,785 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34507,1676142220830' joining acquired barrier for procedure (foo) in zk 2023-02-11 19:03:42,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-11 19:03:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,786 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-11 19:03:42,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 19:03:42,786 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 19:03:42,786 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:42,787 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 19:03:42,787 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 19:03:42,787 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38445,1676142220796' joining acquired barrier for procedure (foo) in zk 2023-02-11 19:03:42,787 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,787 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:42,788 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,788 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:42,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:42,790 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,791 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:42,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:03:42,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:42,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34507,1676142220830' joining acquired barrier for procedure 'foo' on coordinator 2023-02-11 19:03:42,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ff56e05[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:42,792 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-11 19:03:42,792 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,793 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 19:03:42,793 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,793 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:42,793 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 19:03:42,793 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 19:03:42,793 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38445,1676142220796' in zk 2023-02-11 19:03:42,795 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 19:03:42,795 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:42,795 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 19:03:42,796 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 19:03:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:42,797 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,797 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. started... 2023-02-11 19:03:42,797 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cd429014cd17d04d1f60f9eca39086ee 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 19:03:42,825 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f1/bff5a15449f445b8b4730b529eeb31a6 2023-02-11 19:03:42,854 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f2/74107820b02c4db081743c927ffd4173 2023-02-11 19:03:42,860 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:42,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 19:03:42,862 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f1/bff5a15449f445b8b4730b529eeb31a6 as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/bff5a15449f445b8b4730b529eeb31a6 2023-02-11 19:03:42,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:42,862 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:03:42,867 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/bff5a15449f445b8b4730b529eeb31a6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:03:42,867 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f2/74107820b02c4db081743c927ffd4173 as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/74107820b02c4db081743c927ffd4173 2023-02-11 19:03:42,872 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/74107820b02c4db081743c927ffd4173, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:03:42,873 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for cd429014cd17d04d1f60f9eca39086ee in 76ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cd429014cd17d04d1f60f9eca39086ee: 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.' region-info for snapshot=foo 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/bff5a15449f445b8b4730b529eeb31a6] hfiles 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/bff5a15449f445b8b4730b529eeb31a6 for snapshot=foo 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/74107820b02c4db081743c927ffd4173] hfiles 2023-02-11 19:03:42,873 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/74107820b02c4db081743c927ffd4173 for snapshot=foo 2023-02-11 19:03:42,880 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. completed. 2023-02-11 19:03:42,880 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:42,880 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 19:03:42,880 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 19:03:42,880 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,880 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 19:03:42,880 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34507,1676142220830' in zk 2023-02-11 19:03:42,882 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,882 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 19:03:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:42,882 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:42,882 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 19:03:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:03:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:03:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34507,1676142220830': 2023-02-11 19:03:42,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34507,1676142220830' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-11 19:03:42,886 INFO [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-11 19:03:42,886 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:42,887 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:42,887 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-11 19:03:42,887 INFO [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:03:42,889 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,889 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,889 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,889 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:42,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:42,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,889 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:42,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:42,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:42,891 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:42,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:03:42,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,891 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:42,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:03:42,893 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,893 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:03:42,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 19:03:42,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:42,900 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:42,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-11 19:03:42,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-11 19:03:42,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:42,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-11 19:03:42,899 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:42,900 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:42,900 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:42,901 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:03:42,901 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:03:42,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.hbase-snapshot/.tmp/foo 2023-02-11 19:03:42,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.hbase-snapshot/.tmp/foo to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.hbase-snapshot/foo 2023-02-11 19:03:43,062 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:43,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 19:03:43,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:43,064 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:03:43,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-11 19:03:43,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.hbase-snapshot/.tmp/foo 2023-02-11 19:03:43,352 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.hbase-snapshot/.tmp/foo 2023-02-11 19:03:43,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676142222759Consolidate snapshot: foo at 1676142222900 (+141 ms)Loading Region manifests for foo at 1676142222900Writing data manifest for foo at 1676142222905 (+5 ms)Verifying snapshot: foo at 1676142222918 (+13 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676142223352 (+434 ms) 2023-02-11 19:03:43,354 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 19:03:43,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 594 msec 2023-02-11 19:03:43,365 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:43,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 19:03:43,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:03:43,366 INFO [Listener at localhost/35005] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:03:43,370 INFO [Listener at localhost/35005] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:03:43,376 INFO [Listener at localhost/35005] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:03:43,425 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34507] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,526 INFO [Listener at localhost/35005] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:03:43,532 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:03:43,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,534 INFO [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-11 19:03:43,534 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:43,535 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-11 19:03:43,535 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-11 19:03:43,535 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,535 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,537 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:43,537 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:43,537 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:43,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,539 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,539 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-11 19:03:43,539 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-11 19:03:43,540 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,540 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-11 19:03:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38445,1676142220796' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-11 19:03:43,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-11 19:03:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:43,541 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-11 19:03:43,541 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:03:43,541 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:43,541 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,541 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. started... 2023-02-11 19:03:43,541 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cd429014cd17d04d1f60f9eca39086ee 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 19:03:43,543 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,544 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,544 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:43,559 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f1/9df73de15bca422690f32944c29feabe 2023-02-11 19:03:43,588 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f2/a06ecbe173fd4944b26e811ab3b7bf1d 2023-02-11 19:03:43,593 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f1/9df73de15bca422690f32944c29feabe as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/9df73de15bca422690f32944c29feabe 2023-02-11 19:03:43,598 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/9df73de15bca422690f32944c29feabe, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:03:43,599 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/.tmp/f2/a06ecbe173fd4944b26e811ab3b7bf1d as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/a06ecbe173fd4944b26e811ab3b7bf1d 2023-02-11 19:03:43,604 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/a06ecbe173fd4944b26e811ab3b7bf1d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:03:43,605 INFO [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for cd429014cd17d04d1f60f9eca39086ee in 64ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:43,606 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cd429014cd17d04d1f60f9eca39086ee: 2023-02-11 19:03:43,606 DEBUG [rs(jenkins-hbase4.apache.org,34507,1676142220830)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:03:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:03:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-11 19:03:43,606 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34507,1676142220830' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-11 19:03:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,608 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:43,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34507,1676142220830' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-11 19:03:43,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bcaef23[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:43,610 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-11 19:03:43,610 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,611 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-11 19:03:43,611 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-11 19:03:43,611 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-11 19:03:43,611 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-11 19:03:43,611 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38445,1676142220796' in zk 2023-02-11 19:03:43,611 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,611 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:43,611 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34507,1676142220830' in zk 2023-02-11 19:03:43,613 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-11 19:03:43,613 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:43,613 DEBUG [member: 'jenkins-hbase4.apache.org,38445,1676142220796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-11 19:03:43,614 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,614 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-11 19:03:43,614 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,614 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142220830' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-11 19:03:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,34507,1676142220830': 2023-02-11 19:03:43,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34507,1676142220830' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-11 19:03:43,618 INFO [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-11 19:03:43,618 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:43,618 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:43,618 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,618 INFO [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:03:43,620 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:43,620 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:43,620 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:43,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,621 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,622 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:43,623 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:43,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-11 19:03:43,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:03:43,625 DEBUG [(jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:43,626 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:43,625 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:43,626 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:03:43,626 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:43,627 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:43,627 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:43,627 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,627 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,727 DEBUG [Listener at localhost/35005] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:03:43,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:03:43,733 INFO [Listener at localhost/35005] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676142222743 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:43,733 DEBUG [Listener at localhost/35005] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40967/user/jenkins/test-data/ac990c4c-0d52-816f-4b2c-75ed8b643b42/foo/6c53ef72-874f-44c5-90de-f20cbeb9ae0a/data/default/testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,733 INFO [Listener at localhost/35005] snapshot.RestoreSnapshotHelper(239): region to add: cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:43,734 INFO [Listener at localhost/35005] snapshot.RestoreSnapshotHelper(585): clone region=cd429014cd17d04d1f60f9eca39086ee as cd429014cd17d04d1f60f9eca39086ee in snapshot foo 2023-02-11 19:03:43,734 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd429014cd17d04d1f60f9eca39086ee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40967/user/jenkins/test-data/ac990c4c-0d52-816f-4b2c-75ed8b643b42/foo/6c53ef72-874f-44c5-90de-f20cbeb9ae0a 2023-02-11 19:03:43,741 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:43,741 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bff5a15449f445b8b4730b529eeb31a6 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,744 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74107820b02c4db081743c927ffd4173 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,746 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cd429014cd17d04d1f60f9eca39086ee, disabling compactions & flushes 2023-02-11 19:03:43,746 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,746 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,746 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. after waiting 0 ms 2023-02-11 19:03:43,746 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,746 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,746 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cd429014cd17d04d1f60f9eca39086ee: Waiting for close lock at 1676142223746Disabling compacts and flushes for region at 1676142223746Disabling writes for close at 1676142223746Writing region close event to WAL at 1676142223746Closed at 1676142223746 2023-02-11 19:03:43,746 INFO [Listener at localhost/35005] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676142222743 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:43,746 DEBUG [Listener at localhost/35005] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40967/user/jenkins/test-data/ac990c4c-0d52-816f-4b2c-75ed8b643b42/foo/6c53ef72-874f-44c5-90de-f20cbeb9ae0a 2023-02-11 19:03:43,746 DEBUG [Listener at localhost/35005] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40967/user/jenkins/test-data/ac990c4c-0d52-816f-4b2c-75ed8b643b42/foo/6c53ef72-874f-44c5-90de-f20cbeb9ae0a 2023-02-11 19:03:43,747 DEBUG [Listener at localhost/35005] util.CommonFSUtils(699): |-data/ 2023-02-11 19:03:43,747 DEBUG [Listener at localhost/35005] util.CommonFSUtils(699): |----default/ 2023-02-11 19:03:43,748 DEBUG [Listener at localhost/35005] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-11 19:03:43,748 DEBUG [Listener at localhost/35005] util.CommonFSUtils(699): |----------cd429014cd17d04d1f60f9eca39086ee/ 2023-02-11 19:03:43,749 DEBUG [Listener at localhost/35005] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:43,749 DEBUG [Listener at localhost/35005] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:43,749 DEBUG [Listener at localhost/35005] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=cd429014cd17d04d1f60f9eca39086ee-bff5a15449f445b8b4730b529eeb31a6 2023-02-11 19:03:43,749 DEBUG [Listener at localhost/35005] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:43,750 DEBUG [Listener at localhost/35005] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=cd429014cd17d04d1f60f9eca39086ee-74107820b02c4db081743c927ffd4173 2023-02-11 19:03:43,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-11 19:03:43,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-11 19:03:43,754 INFO [Listener at localhost/35005] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,754 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:43,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:03:43,758 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142223757"}]},"ts":"1676142223757"} 2023-02-11 19:03:43,759 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-11 19:03:43,760 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-11 19:03:43,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, UNASSIGN}] 2023-02-11 19:03:43,762 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, UNASSIGN 2023-02-11 19:03:43,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cd429014cd17d04d1f60f9eca39086ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:43,763 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676142223763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142223763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142223763"}]},"ts":"1676142223763"} 2023-02-11 19:03:43,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure cd429014cd17d04d1f60f9eca39086ee, server=jenkins-hbase4.apache.org,34507,1676142220830}] 2023-02-11 19:03:43,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:03:43,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:43,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cd429014cd17d04d1f60f9eca39086ee, disabling compactions & flushes 2023-02-11 19:03:43,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. after waiting 0 ms 2023-02-11 19:03:43,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:43,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee. 2023-02-11 19:03:43,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cd429014cd17d04d1f60f9eca39086ee: Waiting for close lock at 1676142223916Running coprocessor pre-close hooks at 1676142223916Disabling compacts and flushes for region at 1676142223916Disabling writes for close at 1676142223916Writing region close event to WAL at 1676142223917 (+1 ms)Running coprocessor post-close hooks at 1676142223921 (+4 ms)Closed at 1676142223921 2023-02-11 19:03:43,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:43,923 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cd429014cd17d04d1f60f9eca39086ee, regionState=CLOSED 2023-02-11 19:03:43,923 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676142223923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142223923"}]},"ts":"1676142223923"} 2023-02-11 19:03:43,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 19:03:43,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure cd429014cd17d04d1f60f9eca39086ee, server=jenkins-hbase4.apache.org,34507,1676142220830 in 161 msec 2023-02-11 19:03:43,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 19:03:43,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=cd429014cd17d04d1f60f9eca39086ee, UNASSIGN in 165 msec 2023-02-11 19:03:43,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142223928"}]},"ts":"1676142223928"} 2023-02-11 19:03:43,929 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-11 19:03:43,932 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-11 19:03:43,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 179 msec 2023-02-11 19:03:44,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:03:44,061 INFO [Listener at localhost/35005] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-11 19:03:44,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,065 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:03:44,068 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:44,070 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1, FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2, FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/recovered.edits] 2023-02-11 19:03:44,074 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/9df73de15bca422690f32944c29feabe to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/archive/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/9df73de15bca422690f32944c29feabe 2023-02-11 19:03:44,075 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/bff5a15449f445b8b4730b529eeb31a6 to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/archive/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f1/bff5a15449f445b8b4730b529eeb31a6 2023-02-11 19:03:44,078 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/74107820b02c4db081743c927ffd4173 to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/archive/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/74107820b02c4db081743c927ffd4173 2023-02-11 19:03:44,079 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/a06ecbe173fd4944b26e811ab3b7bf1d to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/archive/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/f2/a06ecbe173fd4944b26e811ab3b7bf1d 2023-02-11 19:03:44,081 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/recovered.edits/12.seqid to hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/archive/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee/recovered.edits/12.seqid 2023-02-11 19:03:44,082 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/.tmp/data/default/testInitTableSnapshotMapperJobConfig/cd429014cd17d04d1f60f9eca39086ee 2023-02-11 19:03:44,082 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-11 19:03:44,084 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,086 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-11 19:03:44,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-11 19:03:44,089 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,089 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-11 19:03:44,089 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142224089"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:44,090 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 19:03:44,090 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cd429014cd17d04d1f60f9eca39086ee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676142221974.cd429014cd17d04d1f60f9eca39086ee.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 19:03:44,090 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-11 19:03:44,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676142224090"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:44,095 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-11 19:03:44,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 19:03:44,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 35 msec 2023-02-11 19:03:44,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43213] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:03:44,167 INFO [Listener at localhost/35005] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-11 19:03:44,167 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:03:44,167 INFO [Listener at localhost/35005] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:03:44,167 DEBUG [Listener at localhost/35005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f17c9fa to 127.0.0.1:53692 2023-02-11 19:03:44,168 DEBUG [Listener at localhost/35005] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,168 DEBUG [Listener at localhost/35005] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:03:44,168 DEBUG [Listener at localhost/35005] util.JVMClusterUtil(257): Found active master hash=1632070412, stopped=false 2023-02-11 19:03:44,168 INFO [Listener at localhost/35005] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:44,170 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:44,170 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:44,170 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:44,170 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:44,170 INFO [Listener at localhost/35005] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:03:44,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:44,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:44,172 DEBUG [Listener at localhost/35005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e68a975 to 127.0.0.1:53692 2023-02-11 19:03:44,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:44,172 DEBUG [Listener at localhost/35005] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,172 INFO [Listener at localhost/35005] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38445,1676142220796' ***** 2023-02-11 19:03:44,172 INFO [Listener at localhost/35005] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:44,173 INFO [Listener at localhost/35005] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34507,1676142220830' ***** 2023-02-11 19:03:44,173 INFO [Listener at localhost/35005] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:44,173 INFO [RS:1;jenkins-hbase4:34507] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:44,173 INFO [RS:0;jenkins-hbase4:38445] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:44,173 INFO [RS:1;jenkins-hbase4:34507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:44,173 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:44,173 INFO [RS:1;jenkins-hbase4:34507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:44,174 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:44,174 DEBUG [RS:1;jenkins-hbase4:34507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68101460 to 127.0.0.1:53692 2023-02-11 19:03:44,174 DEBUG [RS:1;jenkins-hbase4:34507] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,174 INFO [RS:1;jenkins-hbase4:34507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:44,174 INFO [RS:1;jenkins-hbase4:34507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:44,174 INFO [RS:1;jenkins-hbase4:34507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:44,174 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:03:44,173 INFO [RS:0;jenkins-hbase4:38445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:44,175 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 19:03:44,175 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 19:03:44,175 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:44,176 DEBUG [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:03:44,176 INFO [RS:0;jenkins-hbase4:38445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:44,176 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(3304): Received CLOSE for d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:44,176 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:44,176 DEBUG [RS:0;jenkins-hbase4:38445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c4e4cb2 to 127.0.0.1:53692 2023-02-11 19:03:44,176 DEBUG [RS:0;jenkins-hbase4:38445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,176 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 19:03:44,177 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1479): Online Regions={d0ef3356dbfe9e507d350e809c4d63ca=hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca.} 2023-02-11 19:03:44,177 DEBUG [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1505): Waiting on d0ef3356dbfe9e507d350e809c4d63ca 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d0ef3356dbfe9e507d350e809c4d63ca, disabling compactions & flushes 2023-02-11 19:03:44,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:44,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. after waiting 0 ms 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:44,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d0ef3356dbfe9e507d350e809c4d63ca 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:03:44,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:44,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-11 19:03:44,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/.tmp/info/b1528f60bf634034a89f0e5108fde700 2023-02-11 19:03:44,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1528f60bf634034a89f0e5108fde700 2023-02-11 19:03:44,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/.tmp/info/3caab463893c4bc28d5fdf4ef81e6d85 2023-02-11 19:03:44,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/.tmp/rep_barrier/beecbd02b8964955ba5ee71f2c314fa0 2023-02-11 19:03:44,215 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:44,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/.tmp/info/3caab463893c4bc28d5fdf4ef81e6d85 as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/info/3caab463893c4bc28d5fdf4ef81e6d85 2023-02-11 19:03:44,218 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:44,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beecbd02b8964955ba5ee71f2c314fa0 2023-02-11 19:03:44,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/info/3caab463893c4bc28d5fdf4ef81e6d85, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:03:44,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d0ef3356dbfe9e507d350e809c4d63ca in 43ms, sequenceid=6, compaction requested=false 2023-02-11 19:03:44,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/.tmp/table/63621a50f0684026985bba65488dd40f 2023-02-11 19:03:44,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/namespace/d0ef3356dbfe9e507d350e809c4d63ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:03:44,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d0ef3356dbfe9e507d350e809c4d63ca: Waiting for close lock at 1676142224176Running coprocessor pre-close hooks at 1676142224176Disabling compacts and flushes for region at 1676142224176Disabling writes for close at 1676142224181 (+5 ms)Obtaining lock to block concurrent updates at 1676142224181Preparing flush snapshotting stores in d0ef3356dbfe9e507d350e809c4d63ca at 1676142224181Finished memstore snapshotting hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142224182 (+1 ms)Flushing stores of hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. at 1676142224182Flushing d0ef3356dbfe9e507d350e809c4d63ca/info: creating writer at 1676142224182Flushing d0ef3356dbfe9e507d350e809c4d63ca/info: appending metadata at 1676142224189 (+7 ms)Flushing d0ef3356dbfe9e507d350e809c4d63ca/info: closing flushed file at 1676142224189Flushing d0ef3356dbfe9e507d350e809c4d63ca/info: reopening flushed file at 1676142224219 (+30 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d0ef3356dbfe9e507d350e809c4d63ca in 43ms, sequenceid=6, compaction requested=false at 1676142224225 (+6 ms)Writing region close event to WAL at 1676142224230 (+5 ms)Running coprocessor post-close hooks at 1676142224237 (+7 ms)Closed at 1676142224237 2023-02-11 19:03:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142221408.d0ef3356dbfe9e507d350e809c4d63ca. 2023-02-11 19:03:44,240 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63621a50f0684026985bba65488dd40f 2023-02-11 19:03:44,241 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/.tmp/info/b1528f60bf634034a89f0e5108fde700 as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/info/b1528f60bf634034a89f0e5108fde700 2023-02-11 19:03:44,245 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1528f60bf634034a89f0e5108fde700 2023-02-11 19:03:44,245 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/info/b1528f60bf634034a89f0e5108fde700, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 19:03:44,246 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/.tmp/rep_barrier/beecbd02b8964955ba5ee71f2c314fa0 as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/rep_barrier/beecbd02b8964955ba5ee71f2c314fa0 2023-02-11 19:03:44,250 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beecbd02b8964955ba5ee71f2c314fa0 2023-02-11 19:03:44,250 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/rep_barrier/beecbd02b8964955ba5ee71f2c314fa0, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 19:03:44,251 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/.tmp/table/63621a50f0684026985bba65488dd40f as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/table/63621a50f0684026985bba65488dd40f 2023-02-11 19:03:44,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63621a50f0684026985bba65488dd40f 2023-02-11 19:03:44,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/table/63621a50f0684026985bba65488dd40f, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 19:03:44,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false 2023-02-11 19:03:44,259 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 19:03:44,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:44,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:44,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142224175Running coprocessor pre-close hooks at 1676142224175Disabling compacts and flushes for region at 1676142224176 (+1 ms)Disabling writes for close at 1676142224181 (+5 ms)Obtaining lock to block concurrent updates at 1676142224181Preparing flush snapshotting stores in 1588230740 at 1676142224181Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676142224182 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676142224182Flushing 1588230740/info: creating writer at 1676142224182Flushing 1588230740/info: appending metadata at 1676142224189 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676142224189Flushing 1588230740/rep_barrier: creating writer at 1676142224205 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676142224206 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676142224207 (+1 ms)Flushing 1588230740/table: creating writer at 1676142224220 (+13 ms)Flushing 1588230740/table: appending metadata at 1676142224222 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676142224222Flushing 1588230740/info: reopening flushed file at 1676142224241 (+19 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676142224247 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676142224252 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false at 1676142224256 (+4 ms)Writing region close event to WAL at 1676142224257 (+1 ms)Running coprocessor post-close hooks at 1676142224260 (+3 ms)Closed at 1676142224260 2023-02-11 19:03:44,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:44,376 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34507,1676142220830; all regions closed. 2023-02-11 19:03:44,377 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38445,1676142220796; all regions closed. 2023-02-11 19:03:44,382 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/WALs/jenkins-hbase4.apache.org,38445,1676142220796/jenkins-hbase4.apache.org%2C38445%2C1676142220796.1676142221762 not finished, retry = 0 2023-02-11 19:03:44,384 DEBUG [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/oldWALs 2023-02-11 19:03:44,384 INFO [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34507%2C1676142220830.meta:.meta(num 1676142221355) 2023-02-11 19:03:44,389 DEBUG [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/oldWALs 2023-02-11 19:03:44,389 INFO [RS:1;jenkins-hbase4:34507] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34507%2C1676142220830:(num 1676142222142) 2023-02-11 19:03:44,389 DEBUG [RS:1;jenkins-hbase4:34507] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,389 INFO [RS:1;jenkins-hbase4:34507] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:44,389 INFO [RS:1;jenkins-hbase4:34507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:44,389 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:44,390 INFO [RS:1;jenkins-hbase4:34507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34507 2023-02-11 19:03:44,391 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:44,391 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:44,391 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142220830 2023-02-11 19:03:44,391 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:44,391 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1902f158 rejected from java.util.concurrent.ThreadPoolExecutor@1d3d76a0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,392 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:44,392 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67ab4629 rejected from java.util.concurrent.ThreadPoolExecutor@1d3d76a0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,394 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34507,1676142220830] 2023-02-11 19:03:44,394 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34507,1676142220830; numProcessing=1 2023-02-11 19:03:44,395 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34507,1676142220830 already deleted, retry=false 2023-02-11 19:03:44,395 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34507,1676142220830 expired; onlineServers=1 2023-02-11 19:03:44,485 DEBUG [RS:0;jenkins-hbase4:38445] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/oldWALs 2023-02-11 19:03:44,485 INFO [RS:0;jenkins-hbase4:38445] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38445%2C1676142220796:(num 1676142221762) 2023-02-11 19:03:44,485 DEBUG [RS:0;jenkins-hbase4:38445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,485 INFO [RS:0;jenkins-hbase4:38445] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:44,485 INFO [RS:0;jenkins-hbase4:38445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:44,485 INFO [RS:0;jenkins-hbase4:38445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:44,485 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:44,486 INFO [RS:0;jenkins-hbase4:38445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:44,486 INFO [RS:0;jenkins-hbase4:38445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:44,486 INFO [RS:0;jenkins-hbase4:38445] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38445 2023-02-11 19:03:44,488 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:44,488 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38445,1676142220796 2023-02-11 19:03:44,488 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21ed2dd6 rejected from java.util.concurrent.ThreadPoolExecutor@25d2bd33[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,490 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38445,1676142220796] 2023-02-11 19:03:44,490 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38445,1676142220796; numProcessing=2 2023-02-11 19:03:44,492 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38445,1676142220796 already deleted, retry=false 2023-02-11 19:03:44,492 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38445,1676142220796 expired; onlineServers=0 2023-02-11 19:03:44,492 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43213,1676142220748' ***** 2023-02-11 19:03:44,492 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:03:44,493 DEBUG [M:0;jenkins-hbase4:43213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6578f3fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:44,493 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43213,1676142220748 2023-02-11 19:03:44,493 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43213,1676142220748; all regions closed. 2023-02-11 19:03:44,493 DEBUG [M:0;jenkins-hbase4:43213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:44,493 DEBUG [M:0;jenkins-hbase4:43213] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:03:44,493 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:03:44,493 DEBUG [M:0;jenkins-hbase4:43213] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:03:44,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142220994] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142220994,5,FailOnTimeoutGroup] 2023-02-11 19:03:44,494 INFO [M:0;jenkins-hbase4:43213] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:03:44,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142220994] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142220994,5,FailOnTimeoutGroup] 2023-02-11 19:03:44,495 INFO [M:0;jenkins-hbase4:43213] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:03:44,495 INFO [M:0;jenkins-hbase4:43213] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:03:44,495 DEBUG [M:0;jenkins-hbase4:43213] master.HMaster(1502): Stopping service threads 2023-02-11 19:03:44,495 INFO [M:0;jenkins-hbase4:43213] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:03:44,496 ERROR [M:0;jenkins-hbase4:43213] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:03:44,496 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:44,496 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:44,496 INFO [M:0;jenkins-hbase4:43213] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:03:44,496 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:03:44,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:44,497 DEBUG [M:0;jenkins-hbase4:43213] zookeeper.ZKUtil(398): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:03:44,497 WARN [M:0;jenkins-hbase4:43213] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:03:44,497 INFO [M:0;jenkins-hbase4:43213] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:03:44,497 INFO [M:0;jenkins-hbase4:43213] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:03:44,498 DEBUG [M:0;jenkins-hbase4:43213] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:44,498 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:44,498 DEBUG [M:0;jenkins-hbase4:43213] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:44,498 DEBUG [M:0;jenkins-hbase4:43213] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:44,498 DEBUG [M:0;jenkins-hbase4:43213] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:44,498 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.88 KB 2023-02-11 19:03:44,513 INFO [M:0;jenkins-hbase4:43213] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c809b3e9ca914574b5196a9a9fdd173b 2023-02-11 19:03:44,517 DEBUG [M:0;jenkins-hbase4:43213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c809b3e9ca914574b5196a9a9fdd173b as hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c809b3e9ca914574b5196a9a9fdd173b 2023-02-11 19:03:44,522 INFO [M:0;jenkins-hbase4:43213] regionserver.HStore(1080): Added hdfs://localhost:40967/user/jenkins/test-data/d133ff5b-1106-b199-4226-7208bdaee2a1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c809b3e9ca914574b5196a9a9fdd173b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 19:03:44,522 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57251, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false 2023-02-11 19:03:44,523 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:44,523 DEBUG [M:0;jenkins-hbase4:43213] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142224498Disabling compacts and flushes for region at 1676142224498Disabling writes for close at 1676142224498Obtaining lock to block concurrent updates at 1676142224498Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142224498Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57251, getHeapSize=68464, getOffHeapSize=0, getCellsCount=145 at 1676142224498Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142224499 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142224500 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142224502 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142224502Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142224518 (+16 ms)Finished flush of dataSize ~55.91 KB/57251, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false at 1676142224522 (+4 ms)Writing region close event to WAL at 1676142224523 (+1 ms)Closed at 1676142224523 2023-02-11 19:03:44,526 INFO [M:0;jenkins-hbase4:43213] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:03:44,526 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:44,527 INFO [M:0;jenkins-hbase4:43213] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43213 2023-02-11 19:03:44,529 DEBUG [M:0;jenkins-hbase4:43213] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43213,1676142220748 already deleted, retry=false 2023-02-11 19:03:44,670 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:44,670 INFO [M:0;jenkins-hbase4:43213] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43213,1676142220748; zookeeper connection closed. 2023-02-11 19:03:44,671 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f507fb rejected from java.util.concurrent.ThreadPoolExecutor@6ca837d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,671 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): master:43213-0x10044c47f7f0000, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:44,672 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58a1f734 rejected from java.util.concurrent.ThreadPoolExecutor@6ca837d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,771 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:44,771 INFO [RS:0;jenkins-hbase4:38445] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38445,1676142220796; zookeeper connection closed. 2023-02-11 19:03:44,771 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19316d7a rejected from java.util.concurrent.ThreadPoolExecutor@25d2bd33[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,771 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:38445-0x10044c47f7f0001, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:44,771 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@357e0f92] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@357e0f92 2023-02-11 19:03:44,771 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6171742e rejected from java.util.concurrent.ThreadPoolExecutor@25d2bd33[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,871 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:44,871 INFO [RS:1;jenkins-hbase4:34507] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34507,1676142220830; zookeeper connection closed. 2023-02-11 19:03:44,871 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f530046 rejected from java.util.concurrent.ThreadPoolExecutor@1d3d76a0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,871 DEBUG [Listener at localhost/35005-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c47f7f0002, quorum=127.0.0.1:53692, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:44,871 ERROR [Listener at localhost/35005-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5378709 rejected from java.util.concurrent.ThreadPoolExecutor@1d3d76a0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:44,871 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@ab9d28f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@ab9d28f 2023-02-11 19:03:44,872 INFO [Listener at localhost/35005] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:03:44,872 WARN [Listener at localhost/35005] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:44,876 INFO [Listener at localhost/35005] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:44,989 WARN [BP-518538733-172.31.14.131-1676142220177 heartbeating to localhost/127.0.0.1:40967] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:44,989 WARN [BP-518538733-172.31.14.131-1676142220177 heartbeating to localhost/127.0.0.1:40967] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-518538733-172.31.14.131-1676142220177 (Datanode Uuid cdc3c2c2-fad5-40d7-b0c1-1f25f50d1003) service to localhost/127.0.0.1:40967 2023-02-11 19:03:44,991 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/dfs/data/data4/current/BP-518538733-172.31.14.131-1676142220177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:44,992 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/dfs/data/data3/current/BP-518538733-172.31.14.131-1676142220177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:44,993 WARN [Listener at localhost/35005] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:45,030 INFO [Listener at localhost/35005] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:45,134 WARN [BP-518538733-172.31.14.131-1676142220177 heartbeating to localhost/127.0.0.1:40967] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:45,134 WARN [BP-518538733-172.31.14.131-1676142220177 heartbeating to localhost/127.0.0.1:40967] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-518538733-172.31.14.131-1676142220177 (Datanode Uuid 2222ae78-c0ae-42e3-b3bc-b31720afce3e) service to localhost/127.0.0.1:40967 2023-02-11 19:03:45,135 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/dfs/data/data1/current/BP-518538733-172.31.14.131-1676142220177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:45,135 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/cluster_e8a8a17f-37af-2c48-a821-7d72ce96cd9e/dfs/data/data2/current/BP-518538733-172.31.14.131-1676142220177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:45,146 INFO [Listener at localhost/35005] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:45,260 INFO [Listener at localhost/35005] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:03:45,280 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:03:45,292 INFO [Listener at localhost/35005] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 154) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:40967 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40967 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40967 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43213,1676142220748)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:40967 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40967 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40967 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:40967 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/35005 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=576 (was 544) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 293), ProcessCount=167 (was 167), AvailableMemoryMB=3990 (was 4028) 2023-02-11 19:03:45,301 INFO [Listener at localhost/35005] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=576, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=167, AvailableMemoryMB=3989 2023-02-11 19:03:45,312 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/hadoop.log.dir so I do NOT create it in target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178 2023-02-11 19:03:45,312 WARN [Listener at localhost/35005] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 19:03:45,312 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/hadoop.tmp.dir so I do NOT create it in target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178 2023-02-11 19:03:45,312 WARN [Listener at localhost/35005] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3f4afa26-8ab0-b1cc-96e8-9c2c265a7490/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 19:03:45,313 DEBUG [Listener at localhost/35005] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178 2023-02-11 19:03:45,313 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:03:45,313 INFO [Listener at localhost/35005] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa, deleteOnExit=true 2023-02-11 19:03:45,313 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:03:45,313 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/test.cache.data in system properties and HBase conf 2023-02-11 19:03:45,313 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:03:45,313 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:03:45,314 DEBUG [Listener at localhost/35005] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:45,314 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:03:45,315 INFO [Listener at localhost/35005] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:03:45,319 WARN [Listener at localhost/35005] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:45,319 WARN [Listener at localhost/35005] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:45,357 WARN [Listener at localhost/35005] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:45,359 INFO [Listener at localhost/35005] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:45,365 INFO [Listener at localhost/35005] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/java.io.tmpdir/Jetty_localhost_37469_hdfs____c3qkzh/webapp 2023-02-11 19:03:45,457 INFO [Listener at localhost/35005] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37469 2023-02-11 19:03:45,461 WARN [Listener at localhost/35005] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:45,461 WARN [Listener at localhost/35005] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:45,500 WARN [Listener at localhost/32807] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:45,516 WARN [Listener at localhost/32807] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:45,519 WARN [Listener at localhost/32807] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:45,520 INFO [Listener at localhost/32807] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:45,528 INFO [Listener at localhost/32807] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/java.io.tmpdir/Jetty_localhost_41727_datanode____.dj1gu2/webapp 2023-02-11 19:03:45,628 INFO [Listener at localhost/32807] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41727 2023-02-11 19:03:45,634 WARN [Listener at localhost/39535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:45,656 WARN [Listener at localhost/39535] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:45,658 WARN [Listener at localhost/39535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:45,659 INFO [Listener at localhost/39535] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:45,663 INFO [Listener at localhost/39535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/java.io.tmpdir/Jetty_localhost_35519_datanode____l64w6a/webapp 2023-02-11 19:03:45,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd3057965e8257c2: Processing first storage report for DS-ba86845f-0d83-447a-b004-4cb916a06643 from datanode 83c50d75-f214-45e2-9738-3a2062e91e84 2023-02-11 19:03:45,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd3057965e8257c2: from storage DS-ba86845f-0d83-447a-b004-4cb916a06643 node DatanodeRegistration(127.0.0.1:41075, datanodeUuid=83c50d75-f214-45e2-9738-3a2062e91e84, infoPort=40733, infoSecurePort=0, ipcPort=39535, storageInfo=lv=-57;cid=testClusterID;nsid=310615307;c=1676142225322), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:45,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd3057965e8257c2: Processing first storage report for DS-24a83fa5-8521-40e1-945f-bffc9b70d4bd from datanode 83c50d75-f214-45e2-9738-3a2062e91e84 2023-02-11 19:03:45,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd3057965e8257c2: from storage DS-24a83fa5-8521-40e1-945f-bffc9b70d4bd node DatanodeRegistration(127.0.0.1:41075, datanodeUuid=83c50d75-f214-45e2-9738-3a2062e91e84, infoPort=40733, infoSecurePort=0, ipcPort=39535, storageInfo=lv=-57;cid=testClusterID;nsid=310615307;c=1676142225322), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:45,768 INFO [Listener at localhost/39535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35519 2023-02-11 19:03:45,776 WARN [Listener at localhost/36327] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:45,873 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb810b906cfd10b9: Processing first storage report for DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902 from datanode 7105efa4-4017-4a56-b3aa-0a49b27a74c9 2023-02-11 19:03:45,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb810b906cfd10b9: from storage DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902 node DatanodeRegistration(127.0.0.1:36153, datanodeUuid=7105efa4-4017-4a56-b3aa-0a49b27a74c9, infoPort=39467, infoSecurePort=0, ipcPort=36327, storageInfo=lv=-57;cid=testClusterID;nsid=310615307;c=1676142225322), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:45,873 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb810b906cfd10b9: Processing first storage report for DS-1fc661f3-cbfe-48be-8139-9c6f52830238 from datanode 7105efa4-4017-4a56-b3aa-0a49b27a74c9 2023-02-11 19:03:45,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb810b906cfd10b9: from storage DS-1fc661f3-cbfe-48be-8139-9c6f52830238 node DatanodeRegistration(127.0.0.1:36153, datanodeUuid=7105efa4-4017-4a56-b3aa-0a49b27a74c9, infoPort=39467, infoSecurePort=0, ipcPort=36327, storageInfo=lv=-57;cid=testClusterID;nsid=310615307;c=1676142225322), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:45,884 DEBUG [Listener at localhost/36327] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178 2023-02-11 19:03:45,886 INFO [Listener at localhost/36327] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/zookeeper_0, clientPort=59226, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:03:45,887 INFO [Listener at localhost/36327] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59226 2023-02-11 19:03:45,887 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,888 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,903 INFO [Listener at localhost/36327] util.FSUtils(479): Created version file at hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12 with version=8 2023-02-11 19:03:45,903 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,904 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,905 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/hbase-staging 2023-02-11 19:03:45,907 INFO [Listener at localhost/36327] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:45,907 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,907 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,908 INFO [Listener at localhost/36327] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:45,908 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,908 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:45,908 INFO [Listener at localhost/36327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:45,910 INFO [Listener at localhost/36327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40255 2023-02-11 19:03:45,910 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,911 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,912 INFO [Listener at localhost/36327] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40255 connecting to ZooKeeper ensemble=127.0.0.1:59226 2023-02-11 19:03:45,920 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:402550x0, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:45,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40255-0x10044c493a20000 connected 2023-02-11 19:03:45,935 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:45,935 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:45,935 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:45,936 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40255 2023-02-11 19:03:45,937 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40255 2023-02-11 19:03:45,938 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40255 2023-02-11 19:03:45,939 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40255 2023-02-11 19:03:45,940 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40255 2023-02-11 19:03:45,940 INFO [Listener at localhost/36327] master.HMaster(439): hbase.rootdir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12, hbase.cluster.distributed=false 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:45,956 INFO [Listener at localhost/36327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:45,957 INFO [Listener at localhost/36327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36693 2023-02-11 19:03:45,957 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:45,958 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:45,959 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,960 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,960 INFO [Listener at localhost/36327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36693 connecting to ZooKeeper ensemble=127.0.0.1:59226 2023-02-11 19:03:45,968 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:366930x0, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:45,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36693-0x10044c493a20001 connected 2023-02-11 19:03:45,970 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:45,970 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:45,971 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:45,972 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36693 2023-02-11 19:03:45,972 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36693 2023-02-11 19:03:45,975 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36693 2023-02-11 19:03:45,975 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36693 2023-02-11 19:03:45,975 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36693 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:45,990 INFO [Listener at localhost/36327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:45,992 INFO [Listener at localhost/36327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39279 2023-02-11 19:03:45,992 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:45,996 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:45,996 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,998 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:45,999 INFO [Listener at localhost/36327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39279 connecting to ZooKeeper ensemble=127.0.0.1:59226 2023-02-11 19:03:46,002 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:392790x0, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:46,003 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:392790x0, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:46,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39279-0x10044c493a20002 connected 2023-02-11 19:03:46,004 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:46,004 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:46,007 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39279 2023-02-11 19:03:46,008 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39279 2023-02-11 19:03:46,008 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39279 2023-02-11 19:03:46,009 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39279 2023-02-11 19:03:46,009 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39279 2023-02-11 19:03:46,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,011 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:46,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,013 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:46,013 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:46,013 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,013 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:46,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:46,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40255,1676142225907 from backup master directory 2023-02-11 19:03:46,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:46,018 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,018 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:46,018 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:46,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/hbase.id with ID: bb30596c-88af-4035-b03b-d31ade511496 2023-02-11 19:03:46,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:46,042 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5d00613f to 127.0.0.1:59226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:46,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a169fd1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:46,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:46,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:03:46,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:46,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store-tmp 2023-02-11 19:03:46,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:46,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:46,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:46,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:46,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:46,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:46,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:46,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142226070Disabling compacts and flushes for region at 1676142226070Disabling writes for close at 1676142226070Writing region close event to WAL at 1676142226070Closed at 1676142226070 2023-02-11 19:03:46,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/WALs/jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40255%2C1676142225907, suffix=, logDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/WALs/jenkins-hbase4.apache.org,40255,1676142225907, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/oldWALs, maxLogs=10 2023-02-11 19:03:46,088 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK] 2023-02-11 19:03:46,088 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK] 2023-02-11 19:03:46,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/WALs/jenkins-hbase4.apache.org,40255,1676142225907/jenkins-hbase4.apache.org%2C40255%2C1676142225907.1676142226073 2023-02-11 19:03:46,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK], DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK]] 2023-02-11 19:03:46,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:46,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:46,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:46,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:46,091 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:46,093 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:03:46,093 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:03:46,094 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:46,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:46,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:46,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:46,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65395127, jitterRate=-0.0255366712808609}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:46,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142226091Initializing all the Stores at 1676142226091Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142226091Cleaning up temporary data from old regions at 1676142226095 (+4 ms)Cleaning up detritus from prior splits at 1676142226096 (+1 ms)Region opened successfully at 1676142226101 (+5 ms) 2023-02-11 19:03:46,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:03:46,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:03:46,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:03:46,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:03:46,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 19:03:46,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 19:03:46,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:03:46,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:03:46,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:03:46,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:03:46,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:03:46,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:03:46,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:03:46,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:03:46,117 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:03:46,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:03:46,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:03:46,121 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:46,121 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:46,121 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:46,121 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40255,1676142225907, sessionid=0x10044c493a20000, setting cluster-up flag (Was=false) 2023-02-11 19:03:46,126 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:03:46,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,135 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:03:46,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:46,141 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.hbase-snapshot/.tmp 2023-02-11 19:03:46,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142256148 2023-02-11 19:03:46,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:03:46,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:03:46,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:03:46,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:03:46,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:03:46,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:03:46,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,152 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:46,152 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:03:46,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142226153,5,FailOnTimeoutGroup] 2023-02-11 19:03:46,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142226153,5,FailOnTimeoutGroup] 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,153 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:46,164 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:46,164 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:46,164 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12 2023-02-11 19:03:46,211 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(952): ClusterId : bb30596c-88af-4035-b03b-d31ade511496 2023-02-11 19:03:46,211 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(952): ClusterId : bb30596c-88af-4035-b03b-d31ade511496 2023-02-11 19:03:46,212 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:46,212 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:46,214 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:46,214 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:46,214 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:46,214 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:46,217 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:46,218 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:46,218 DEBUG [RS:1;jenkins-hbase4:39279] zookeeper.ReadOnlyZKClient(139): Connect 0x4a547229 to 127.0.0.1:59226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:46,219 DEBUG [RS:0;jenkins-hbase4:36693] zookeeper.ReadOnlyZKClient(139): Connect 0x40946e26 to 127.0.0.1:59226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:46,224 DEBUG [RS:1;jenkins-hbase4:39279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44938513, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:46,224 DEBUG [RS:0;jenkins-hbase4:36693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e538844, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:46,224 DEBUG [RS:1;jenkins-hbase4:39279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ac1959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:46,225 DEBUG [RS:0;jenkins-hbase4:36693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a6c0556, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:46,234 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36693 2023-02-11 19:03:46,234 INFO [RS:0;jenkins-hbase4:36693] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:46,234 INFO [RS:0;jenkins-hbase4:36693] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:46,234 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:46,234 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40255,1676142225907 with isa=jenkins-hbase4.apache.org/172.31.14.131:36693, startcode=1676142225955 2023-02-11 19:03:46,234 DEBUG [RS:0;jenkins-hbase4:36693] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:46,236 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49017, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:46,236 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39279 2023-02-11 19:03:46,237 INFO [RS:1;jenkins-hbase4:39279] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:46,238 INFO [RS:1;jenkins-hbase4:39279] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:46,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,238 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:46,238 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12 2023-02-11 19:03:46,238 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40255,1676142225907 with isa=jenkins-hbase4.apache.org/172.31.14.131:39279, startcode=1676142225989 2023-02-11 19:03:46,238 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32807 2023-02-11 19:03:46,238 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:46,238 DEBUG [RS:1;jenkins-hbase4:39279] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:46,240 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:46,240 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43053, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:46,240 DEBUG [RS:0;jenkins-hbase4:36693] zookeeper.ZKUtil(162): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,240 WARN [RS:0;jenkins-hbase4:36693] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:46,241 INFO [RS:0;jenkins-hbase4:36693] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:46,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,241 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,241 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36693,1676142225955] 2023-02-11 19:03:46,241 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12 2023-02-11 19:03:46,241 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32807 2023-02-11 19:03:46,241 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:46,246 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:46,247 DEBUG [RS:1;jenkins-hbase4:39279] zookeeper.ZKUtil(162): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,247 WARN [RS:1;jenkins-hbase4:39279] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:46,247 INFO [RS:1;jenkins-hbase4:39279] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:46,247 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39279,1676142225989] 2023-02-11 19:03:46,247 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,247 DEBUG [RS:0;jenkins-hbase4:36693] zookeeper.ZKUtil(162): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,248 DEBUG [RS:0;jenkins-hbase4:36693] zookeeper.ZKUtil(162): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,250 DEBUG [RS:0;jenkins-hbase4:36693] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:46,250 INFO [RS:0;jenkins-hbase4:36693] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:46,251 DEBUG [RS:1;jenkins-hbase4:39279] zookeeper.ZKUtil(162): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,251 DEBUG [RS:1;jenkins-hbase4:39279] zookeeper.ZKUtil(162): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,251 INFO [RS:0;jenkins-hbase4:36693] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:46,251 INFO [RS:0;jenkins-hbase4:36693] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:46,252 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,252 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:46,252 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:46,252 INFO [RS:1;jenkins-hbase4:39279] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:46,253 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,253 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,253 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,253 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,253 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,254 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,254 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:46,254 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,254 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,254 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,254 DEBUG [RS:0;jenkins-hbase4:36693] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,256 INFO [RS:1;jenkins-hbase4:39279] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:46,262 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,262 INFO [RS:1;jenkins-hbase4:39279] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:46,262 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,262 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,262 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,262 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:46,263 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,264 DEBUG [RS:1;jenkins-hbase4:39279] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:46,268 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,268 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,268 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,274 INFO [RS:0;jenkins-hbase4:36693] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:46,274 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36693,1676142225955-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,278 INFO [RS:1;jenkins-hbase4:39279] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:46,278 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39279,1676142225989-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,286 INFO [RS:0;jenkins-hbase4:36693] regionserver.Replication(203): jenkins-hbase4.apache.org,36693,1676142225955 started 2023-02-11 19:03:46,286 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36693,1676142225955, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36693, sessionid=0x10044c493a20001 2023-02-11 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:36693] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:36693] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36693,1676142225955' 2023-02-11 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:36693] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:46,286 DEBUG [RS:0;jenkins-hbase4:36693] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36693,1676142225955' 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:46,287 DEBUG [RS:0;jenkins-hbase4:36693] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:46,287 INFO [RS:0;jenkins-hbase4:36693] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:46,287 INFO [RS:0;jenkins-hbase4:36693] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:46,288 INFO [RS:1;jenkins-hbase4:39279] regionserver.Replication(203): jenkins-hbase4.apache.org,39279,1676142225989 started 2023-02-11 19:03:46,289 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39279,1676142225989, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39279, sessionid=0x10044c493a20002 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39279,1676142225989' 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39279,1676142225989' 2023-02-11 19:03:46,289 DEBUG [RS:1;jenkins-hbase4:39279] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:46,290 DEBUG [RS:1;jenkins-hbase4:39279] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:46,290 DEBUG [RS:1;jenkins-hbase4:39279] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:46,290 INFO [RS:1;jenkins-hbase4:39279] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:46,290 INFO [RS:1;jenkins-hbase4:39279] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:46,575 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:46,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:46,578 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/info 2023-02-11 19:03:46,578 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:46,578 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,579 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:46,580 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:46,580 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:46,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:46,582 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/table 2023-02-11 19:03:46,582 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:46,583 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,583 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740 2023-02-11 19:03:46,584 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740 2023-02-11 19:03:46,587 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:46,588 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:46,593 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:46,593 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65180727, jitterRate=-0.02873148024082184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:46,593 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142226575Initializing all the Stores at 1676142226576 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142226576Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142226576Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142226576Cleaning up temporary data from old regions at 1676142226585 (+9 ms)Cleaning up detritus from prior splits at 1676142226586 (+1 ms)Region opened successfully at 1676142226593 (+7 ms) 2023-02-11 19:03:46,594 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:46,594 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:46,594 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:46,594 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:46,594 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:46,594 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:46,594 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142226594Disabling compacts and flushes for region at 1676142226594Disabling writes for close at 1676142226594Writing region close event to WAL at 1676142226594Closed at 1676142226594 2023-02-11 19:03:46,595 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:46,595 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:03:46,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:03:46,597 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:03:46,599 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:03:46,749 DEBUG [jenkins-hbase4:40255] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:03:46,749 DEBUG [jenkins-hbase4:40255] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:46,751 DEBUG [jenkins-hbase4:40255] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:46,751 DEBUG [jenkins-hbase4:40255] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:46,751 DEBUG [jenkins-hbase4:40255] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:46,752 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39279,1676142225989, state=OPENING 2023-02-11 19:03:46,753 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:03:46,754 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:46,755 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:46,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:46,875 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:03:46,909 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:46,909 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:46,910 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55854, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:46,914 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:03:46,914 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:46,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39279%2C1676142225989.meta, suffix=.meta, logDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,39279,1676142225989, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/oldWALs, maxLogs=32 2023-02-11 19:03:46,934 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK] 2023-02-11 19:03:46,934 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK] 2023-02-11 19:03:46,936 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,39279,1676142225989/jenkins-hbase4.apache.org%2C39279%2C1676142225989.meta.1676142226916.meta 2023-02-11 19:03:46,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK], DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK]] 2023-02-11 19:03:46,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:46,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:03:46,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:03:46,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:03:46,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:03:46,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:46,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:03:46,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:03:46,942 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:46,943 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/info 2023-02-11 19:03:46,943 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/info 2023-02-11 19:03:46,943 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:46,944 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,944 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:46,945 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:46,945 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:46,945 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:46,945 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:46,946 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/table 2023-02-11 19:03:46,946 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/table 2023-02-11 19:03:46,947 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:46,947 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:46,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740 2023-02-11 19:03:46,949 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740 2023-02-11 19:03:46,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:46,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:46,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65322583, jitterRate=-0.026617661118507385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:46,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142226940Writing region info on filesystem at 1676142226940Initializing all the Stores at 1676142226941 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142226941Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142226941Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142226941Cleaning up temporary data from old regions at 1676142226951 (+10 ms)Cleaning up detritus from prior splits at 1676142226953 (+2 ms)Running coprocessor post-open hooks at 1676142226959 (+6 ms)Region opened successfully at 1676142226959 2023-02-11 19:03:46,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142226909 2023-02-11 19:03:46,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:03:46,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:03:46,966 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39279,1676142225989, state=OPEN 2023-02-11 19:03:46,967 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:03:46,967 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:46,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:03:46,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39279,1676142225989 in 212 msec 2023-02-11 19:03:46,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:03:46,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 374 msec 2023-02-11 19:03:46,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 828 msec 2023-02-11 19:03:46,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142226012, completionTime=-1 2023-02-11 19:03:46,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:03:46,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:03:46,975 DEBUG [hconnection-0xa3aef24-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:46,976 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:46,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:03:46,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142286977 2023-02-11 19:03:46,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142346977 2023-02-11 19:03:46,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-11 19:03:46,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40255,1676142225907-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40255,1676142225907-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40255,1676142225907-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40255, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:46,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:03:46,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:46,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:03:46,987 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:03:46,987 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:46,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:46,989 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:46,990 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f empty. 2023-02-11 19:03:46,990 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:46,990 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:03:47,007 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:47,008 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3adc064ba8379502fd26b187dfac1c1f, NAME => 'hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,021 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3adc064ba8379502fd26b187dfac1c1f, disabling compactions & flushes 2023-02-11 19:03:47,022 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. after waiting 0 ms 2023-02-11 19:03:47,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,022 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,022 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3adc064ba8379502fd26b187dfac1c1f: Waiting for close lock at 1676142227022Disabling compacts and flushes for region at 1676142227022Disabling writes for close at 1676142227022Writing region close event to WAL at 1676142227022Closed at 1676142227022 2023-02-11 19:03:47,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:47,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142227026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227026"}]},"ts":"1676142227026"} 2023-02-11 19:03:47,030 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:47,032 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:47,032 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142227032"}]},"ts":"1676142227032"} 2023-02-11 19:03:47,033 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:03:47,036 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:47,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:47,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:47,037 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:47,039 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3adc064ba8379502fd26b187dfac1c1f, ASSIGN}] 2023-02-11 19:03:47,042 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3adc064ba8379502fd26b187dfac1c1f, ASSIGN 2023-02-11 19:03:47,044 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3adc064ba8379502fd26b187dfac1c1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39279,1676142225989; forceNewPlan=false, retain=false 2023-02-11 19:03:47,194 INFO [jenkins-hbase4:40255] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:47,195 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3adc064ba8379502fd26b187dfac1c1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,195 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142227195"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227195"}]},"ts":"1676142227195"} 2023-02-11 19:03:47,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3adc064ba8379502fd26b187dfac1c1f, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:47,289 INFO [RS:0;jenkins-hbase4:36693] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36693%2C1676142225955, suffix=, logDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,36693,1676142225955, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/oldWALs, maxLogs=32 2023-02-11 19:03:47,291 INFO [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39279%2C1676142225989, suffix=, logDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,39279,1676142225989, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/oldWALs, maxLogs=32 2023-02-11 19:03:47,304 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK] 2023-02-11 19:03:47,304 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK] 2023-02-11 19:03:47,306 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK] 2023-02-11 19:03:47,306 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK] 2023-02-11 19:03:47,309 INFO [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,39279,1676142225989/jenkins-hbase4.apache.org%2C39279%2C1676142225989.1676142227292 2023-02-11 19:03:47,309 DEBUG [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK], DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK]] 2023-02-11 19:03:47,310 INFO [RS:0;jenkins-hbase4:36693] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/WALs/jenkins-hbase4.apache.org,36693,1676142225955/jenkins-hbase4.apache.org%2C36693%2C1676142225955.1676142227290 2023-02-11 19:03:47,310 DEBUG [RS:0;jenkins-hbase4:36693] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41075,DS-ba86845f-0d83-447a-b004-4cb916a06643,DISK], DatanodeInfoWithStorage[127.0.0.1:36153,DS-ec51c1b0-cacb-47af-9fdd-d9c28a958902,DISK]] 2023-02-11 19:03:47,353 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3adc064ba8379502fd26b187dfac1c1f, NAME => 'hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:47,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,355 INFO [StoreOpener-3adc064ba8379502fd26b187dfac1c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,356 DEBUG [StoreOpener-3adc064ba8379502fd26b187dfac1c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/info 2023-02-11 19:03:47,356 DEBUG [StoreOpener-3adc064ba8379502fd26b187dfac1c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/info 2023-02-11 19:03:47,356 INFO [StoreOpener-3adc064ba8379502fd26b187dfac1c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3adc064ba8379502fd26b187dfac1c1f columnFamilyName info 2023-02-11 19:03:47,357 INFO [StoreOpener-3adc064ba8379502fd26b187dfac1c1f-1] regionserver.HStore(310): Store=3adc064ba8379502fd26b187dfac1c1f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,361 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:47,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3adc064ba8379502fd26b187dfac1c1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65726854, jitterRate=-0.0205935537815094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:47,363 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3adc064ba8379502fd26b187dfac1c1f: Running coprocessor pre-open hook at 1676142227354Writing region info on filesystem at 1676142227354Initializing all the Stores at 1676142227354Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142227354Cleaning up temporary data from old regions at 1676142227359 (+5 ms)Cleaning up detritus from prior splits at 1676142227359Running coprocessor post-open hooks at 1676142227363 (+4 ms)Region opened successfully at 1676142227363 2023-02-11 19:03:47,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f., pid=6, masterSystemTime=1676142227350 2023-02-11 19:03:47,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,366 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:47,366 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3adc064ba8379502fd26b187dfac1c1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,366 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142227366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142227366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142227366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142227366"}]},"ts":"1676142227366"} 2023-02-11 19:03:47,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:03:47,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3adc064ba8379502fd26b187dfac1c1f, server=jenkins-hbase4.apache.org,39279,1676142225989 in 171 msec 2023-02-11 19:03:47,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:03:47,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3adc064ba8379502fd26b187dfac1c1f, ASSIGN in 332 msec 2023-02-11 19:03:47,371 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:47,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142227372"}]},"ts":"1676142227372"} 2023-02-11 19:03:47,373 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:03:47,377 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:47,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 392 msec 2023-02-11 19:03:47,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:03:47,388 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:47,388 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:47,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:03:47,398 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:47,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 19:03:47,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:03:47,410 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:47,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-11 19:03:47,416 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:03:47,419 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:03:47,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.401sec 2023-02-11 19:03:47,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:03:47,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:03:47,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:03:47,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40255,1676142225907-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:03:47,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40255,1676142225907-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:03:47,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:03:47,512 DEBUG [Listener at localhost/36327] zookeeper.ReadOnlyZKClient(139): Connect 0x73e84268 to 127.0.0.1:59226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:47,517 DEBUG [Listener at localhost/36327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@452667c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:47,519 DEBUG [hconnection-0x3b67361e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:47,520 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:47,522 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:47,522 DEBUG [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:03:47,523 DEBUG [Listener at localhost/36327] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:03:47,525 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:03:47,525 INFO [Listener at localhost/36327] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-11 19:03:47,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-11 19:03:47,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:03:47,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:32962 deadline: 1676142287526, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-11 19:03:47,526 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-11 19:03:47,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:47,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:47,531 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:47,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-11 19:03:47,532 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:47,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,539 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 empty. 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 empty. 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 empty. 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f empty. 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 empty. 2023-02-11 19:03:47,540 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 empty. 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 empty. 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b empty. 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 empty. 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d empty. 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,541 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,542 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:47,542 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d 2023-02-11 19:03:47,542 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,542 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-11 19:03:47,550 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:47,552 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => acf9c9b53025adcced4cf9882c5cf898, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,552 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 38416af4cd6d58c860a4d3a6b4583041, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,552 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => f1f3ec0d707d000241353c40c0e15f85, NAME => 'testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,565 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,565 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,565 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing f1f3ec0d707d000241353c40c0e15f85, disabling compactions & flushes 2023-02-11 19:03:47,565 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 38416af4cd6d58c860a4d3a6b4583041, disabling compactions & flushes 2023-02-11 19:03:47,565 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:47,565 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:47,565 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. after waiting 0 ms 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. after waiting 0 ms 2023-02-11 19:03:47,566 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 38416af4cd6d58c860a4d3a6b4583041: Waiting for close lock at 1676142227565Disabling compacts and flushes for region at 1676142227565Disabling writes for close at 1676142227566 (+1 ms)Writing region close event to WAL at 1676142227566Closed at 1676142227566 2023-02-11 19:03:47,566 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:47,566 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for f1f3ec0d707d000241353c40c0e15f85: Waiting for close lock at 1676142227565Disabling compacts and flushes for region at 1676142227565Disabling writes for close at 1676142227566 (+1 ms)Writing region close event to WAL at 1676142227566Closed at 1676142227566 2023-02-11 19:03:47,566 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => ab3d861e282353c06e89875e8c583f4b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,567 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c85ce637d478f3134eeab1bece5f1519, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,569 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,569 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing acf9c9b53025adcced4cf9882c5cf898, disabling compactions & flushes 2023-02-11 19:03:47,569 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,569 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,569 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. after waiting 0 ms 2023-02-11 19:03:47,569 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,569 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,569 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for acf9c9b53025adcced4cf9882c5cf898: Waiting for close lock at 1676142227569Disabling compacts and flushes for region at 1676142227569Disabling writes for close at 1676142227569Writing region close event to WAL at 1676142227569Closed at 1676142227569 2023-02-11 19:03:47,570 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 00d6e74697fa1ce107080ebe745c736f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,576 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,576 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing ab3d861e282353c06e89875e8c583f4b, disabling compactions & flushes 2023-02-11 19:03:47,576 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:47,576 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:47,576 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. after waiting 0 ms 2023-02-11 19:03:47,576 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:47,576 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:47,576 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for ab3d861e282353c06e89875e8c583f4b: Waiting for close lock at 1676142227576Disabling compacts and flushes for region at 1676142227576Disabling writes for close at 1676142227576Writing region close event to WAL at 1676142227576Closed at 1676142227576 2023-02-11 19:03:47,577 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9f707008aad36f10c42eb3e971cd2975, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing c85ce637d478f3134eeab1bece5f1519, disabling compactions & flushes 2023-02-11 19:03:47,579 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. after waiting 0 ms 2023-02-11 19:03:47,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,579 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,579 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for c85ce637d478f3134eeab1bece5f1519: Waiting for close lock at 1676142227579Disabling compacts and flushes for region at 1676142227579Disabling writes for close at 1676142227579Writing region close event to WAL at 1676142227579Closed at 1676142227579 2023-02-11 19:03:47,579 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 250fd9e9a84209694813519eb2c15120, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,580 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,580 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 00d6e74697fa1ce107080ebe745c736f, disabling compactions & flushes 2023-02-11 19:03:47,581 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,581 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,581 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. after waiting 0 ms 2023-02-11 19:03:47,581 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,581 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,581 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 00d6e74697fa1ce107080ebe745c736f: Waiting for close lock at 1676142227580Disabling compacts and flushes for region at 1676142227580Disabling writes for close at 1676142227581 (+1 ms)Writing region close event to WAL at 1676142227581Closed at 1676142227581 2023-02-11 19:03:47,581 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 08195ed3d944596f507693fab589a44d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,588 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,588 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 9f707008aad36f10c42eb3e971cd2975, disabling compactions & flushes 2023-02-11 19:03:47,588 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,588 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,588 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. after waiting 0 ms 2023-02-11 19:03:47,588 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,588 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,588 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 9f707008aad36f10c42eb3e971cd2975: Waiting for close lock at 1676142227588Disabling compacts and flushes for region at 1676142227588Disabling writes for close at 1676142227588Writing region close event to WAL at 1676142227588Closed at 1676142227588 2023-02-11 19:03:47,589 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 017c1ac7e61aee05e086a4f402774949, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 250fd9e9a84209694813519eb2c15120, disabling compactions & flushes 2023-02-11 19:03:47,592 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. after waiting 0 ms 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,592 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 250fd9e9a84209694813519eb2c15120: Waiting for close lock at 1676142227592Disabling compacts and flushes for region at 1676142227592Disabling writes for close at 1676142227592Writing region close event to WAL at 1676142227592Closed at 1676142227592 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 08195ed3d944596f507693fab589a44d, disabling compactions & flushes 2023-02-11 19:03:47,592 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. after waiting 0 ms 2023-02-11 19:03:47,592 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:47,593 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:47,593 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 08195ed3d944596f507693fab589a44d: Waiting for close lock at 1676142227592Disabling compacts and flushes for region at 1676142227592Disabling writes for close at 1676142227592Writing region close event to WAL at 1676142227592Closed at 1676142227592 2023-02-11 19:03:47,597 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 017c1ac7e61aee05e086a4f402774949, disabling compactions & flushes 2023-02-11 19:03:47,598 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. after waiting 0 ms 2023-02-11 19:03:47,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,598 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,598 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 017c1ac7e61aee05e086a4f402774949: Waiting for close lock at 1676142227598Disabling compacts and flushes for region at 1676142227598Disabling writes for close at 1676142227598Writing region close event to WAL at 1676142227598Closed at 1676142227598 2023-02-11 19:03:47,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142227600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142227600"}]},"ts":"1676142227600"} 2023-02-11 19:03:47,603 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 19:03:47,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:47,604 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142227604"}]},"ts":"1676142227604"} 2023-02-11 19:03:47,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-11 19:03:47,609 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:47,614 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:47,614 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:47,614 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:47,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, ASSIGN}] 2023-02-11 19:03:47,617 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, ASSIGN 2023-02-11 19:03:47,617 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, ASSIGN 2023-02-11 19:03:47,617 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, ASSIGN 2023-02-11 19:03:47,617 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, ASSIGN 2023-02-11 19:03:47,617 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39279,1676142225989; forceNewPlan=false, retain=false 2023-02-11 19:03:47,617 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36693,1676142225955; forceNewPlan=false, retain=false 2023-02-11 19:03:47,618 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39279,1676142225989; forceNewPlan=false, retain=false 2023-02-11 19:03:47,618 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36693,1676142225955; forceNewPlan=false, retain=false 2023-02-11 19:03:47,618 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, ASSIGN 2023-02-11 19:03:47,618 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, ASSIGN 2023-02-11 19:03:47,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, ASSIGN 2023-02-11 19:03:47,620 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, ASSIGN 2023-02-11 19:03:47,620 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, ASSIGN 2023-02-11 19:03:47,620 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36693,1676142225955; forceNewPlan=false, retain=false 2023-02-11 19:03:47,620 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39279,1676142225989; forceNewPlan=false, retain=false 2023-02-11 19:03:47,621 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36693,1676142225955; forceNewPlan=false, retain=false 2023-02-11 19:03:47,621 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39279,1676142225989; forceNewPlan=false, retain=false 2023-02-11 19:03:47,621 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36693,1676142225955; forceNewPlan=false, retain=false 2023-02-11 19:03:47,621 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, ASSIGN 2023-02-11 19:03:47,622 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39279,1676142225989; forceNewPlan=false, retain=false 2023-02-11 19:03:47,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:47,768 INFO [jenkins-hbase4:40255] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 19:03:47,774 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=38416af4cd6d58c860a4d3a6b4583041, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,774 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c85ce637d478f3134eeab1bece5f1519, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,774 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=08195ed3d944596f507693fab589a44d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,774 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9f707008aad36f10c42eb3e971cd2975, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,774 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=acf9c9b53025adcced4cf9882c5cf898, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,774 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227774"}]},"ts":"1676142227774"} 2023-02-11 19:03:47,774 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227774"}]},"ts":"1676142227774"} 2023-02-11 19:03:47,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227774"}]},"ts":"1676142227774"} 2023-02-11 19:03:47,774 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227774"}]},"ts":"1676142227774"} 2023-02-11 19:03:47,774 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227774"}]},"ts":"1676142227774"} 2023-02-11 19:03:47,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 08195ed3d944596f507693fab589a44d, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:47,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure acf9c9b53025adcced4cf9882c5cf898, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:47,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure c85ce637d478f3134eeab1bece5f1519, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:47,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure 38416af4cd6d58c860a4d3a6b4583041, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:47,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 9f707008aad36f10c42eb3e971cd2975, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:47,779 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=00d6e74697fa1ce107080ebe745c736f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227779"}]},"ts":"1676142227779"} 2023-02-11 19:03:47,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=017c1ac7e61aee05e086a4f402774949, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142227781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227781"}]},"ts":"1676142227781"} 2023-02-11 19:03:47,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 00d6e74697fa1ce107080ebe745c736f, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:47,781 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ab3d861e282353c06e89875e8c583f4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,781 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227781"}]},"ts":"1676142227781"} 2023-02-11 19:03:47,782 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f1f3ec0d707d000241353c40c0e15f85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,782 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142227782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227782"}]},"ts":"1676142227782"} 2023-02-11 19:03:47,782 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=250fd9e9a84209694813519eb2c15120, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142227782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142227782"}]},"ts":"1676142227782"} 2023-02-11 19:03:47,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure ab3d861e282353c06e89875e8c583f4b, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:47,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure 017c1ac7e61aee05e086a4f402774949, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:47,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure f1f3ec0d707d000241353c40c0e15f85, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:47,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 250fd9e9a84209694813519eb2c15120, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:47,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:47,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => acf9c9b53025adcced4cf9882c5cf898, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 19:03:47,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,934 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,934 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,934 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:47,935 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1 2023-02-11 19:03:47,935 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1 2023-02-11 19:03:47,935 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acf9c9b53025adcced4cf9882c5cf898 columnFamilyName f1 2023-02-11 19:03:47,935 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35938, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:47,936 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(310): Store=acf9c9b53025adcced4cf9882c5cf898/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,936 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,937 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2 2023-02-11 19:03:47,937 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2 2023-02-11 19:03:47,937 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acf9c9b53025adcced4cf9882c5cf898 columnFamilyName f2 2023-02-11 19:03:47,938 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(310): Store=acf9c9b53025adcced4cf9882c5cf898/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 017c1ac7e61aee05e086a4f402774949, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 19:03:47,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,939 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,941 DEBUG [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f1 2023-02-11 19:03:47,941 DEBUG [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f1 2023-02-11 19:03:47,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,941 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 017c1ac7e61aee05e086a4f402774949 columnFamilyName f1 2023-02-11 19:03:47,941 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(310): Store=017c1ac7e61aee05e086a4f402774949/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,941 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:47,943 DEBUG [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f2 2023-02-11 19:03:47,943 DEBUG [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f2 2023-02-11 19:03:47,943 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 017c1ac7e61aee05e086a4f402774949 columnFamilyName f2 2023-02-11 19:03:47,943 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(310): Store=017c1ac7e61aee05e086a4f402774949/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened acf9c9b53025adcced4cf9882c5cf898; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59858862, jitterRate=-0.1080334484577179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for acf9c9b53025adcced4cf9882c5cf898: Running coprocessor pre-open hook at 1676142227933Writing region info on filesystem at 1676142227933Initializing all the Stores at 1676142227933Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227933Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227933Cleaning up temporary data from old regions at 1676142227940 (+7 ms)Cleaning up detritus from prior splits at 1676142227940Running coprocessor post-open hooks at 1676142227945 (+5 ms)Region opened successfully at 1676142227945 2023-02-11 19:03:47,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898., pid=22, masterSystemTime=1676142227928 2023-02-11 19:03:47,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:47,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,947 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=acf9c9b53025adcced4cf9882c5cf898, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9f707008aad36f10c42eb3e971cd2975, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 19:03:47,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142227947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142227947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142227947"}]},"ts":"1676142227947"} 2023-02-11 19:03:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:47,950 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,952 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1 2023-02-11 19:03:47,952 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1 2023-02-11 19:03:47,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-11 19:03:47,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure acf9c9b53025adcced4cf9882c5cf898, server=jenkins-hbase4.apache.org,39279,1676142225989 in 172 msec 2023-02-11 19:03:47,953 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f707008aad36f10c42eb3e971cd2975 columnFamilyName f1 2023-02-11 19:03:47,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 017c1ac7e61aee05e086a4f402774949; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67002787, jitterRate=-0.0015806704759597778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 017c1ac7e61aee05e086a4f402774949: Running coprocessor pre-open hook at 1676142227939Writing region info on filesystem at 1676142227939Initializing all the Stores at 1676142227939Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227939Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227939Cleaning up temporary data from old regions at 1676142227945 (+6 ms)Cleaning up detritus from prior splits at 1676142227946 (+1 ms)Running coprocessor post-open hooks at 1676142227953 (+7 ms)Region opened successfully at 1676142227953 2023-02-11 19:03:47,953 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(310): Store=9f707008aad36f10c42eb3e971cd2975/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,953 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, ASSIGN in 337 msec 2023-02-11 19:03:47,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949., pid=28, masterSystemTime=1676142227933 2023-02-11 19:03:47,956 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2 2023-02-11 19:03:47,956 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2 2023-02-11 19:03:47,956 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f707008aad36f10c42eb3e971cd2975 columnFamilyName f2 2023-02-11 19:03:47,957 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(310): Store=9f707008aad36f10c42eb3e971cd2975/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:47,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 250fd9e9a84209694813519eb2c15120, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 19:03:47,958 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=017c1ac7e61aee05e086a4f402774949, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,958 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142227958"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142227958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142227958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142227958"}]},"ts":"1676142227958"} 2023-02-11 19:03:47,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,960 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-11 19:03:47,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure 017c1ac7e61aee05e086a4f402774949, server=jenkins-hbase4.apache.org,36693,1676142225955 in 175 msec 2023-02-11 19:03:47,961 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1 2023-02-11 19:03:47,961 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1 2023-02-11 19:03:47,961 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 250fd9e9a84209694813519eb2c15120 columnFamilyName f1 2023-02-11 19:03:47,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, ASSIGN in 346 msec 2023-02-11 19:03:47,962 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(310): Store=250fd9e9a84209694813519eb2c15120/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:47,962 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,963 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2 2023-02-11 19:03:47,963 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2 2023-02-11 19:03:47,963 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 250fd9e9a84209694813519eb2c15120 columnFamilyName f2 2023-02-11 19:03:47,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,964 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(310): Store=250fd9e9a84209694813519eb2c15120/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9f707008aad36f10c42eb3e971cd2975; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60965992, jitterRate=-0.09153592586517334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9f707008aad36f10c42eb3e971cd2975: Running coprocessor pre-open hook at 1676142227948Writing region info on filesystem at 1676142227948Initializing all the Stores at 1676142227949 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227949Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227950 (+1 ms)Cleaning up temporary data from old regions at 1676142227959 (+9 ms)Cleaning up detritus from prior splits at 1676142227960 (+1 ms)Running coprocessor post-open hooks at 1676142227964 (+4 ms)Region opened successfully at 1676142227964 2023-02-11 19:03:47,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975., pid=25, masterSystemTime=1676142227928 2023-02-11 19:03:47,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:47,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c85ce637d478f3134eeab1bece5f1519, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 19:03:47,966 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9f707008aad36f10c42eb3e971cd2975, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,967 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142227966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142227966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142227966"}]},"ts":"1676142227966"} 2023-02-11 19:03:47,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:47,968 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,969 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1 2023-02-11 19:03:47,969 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1 2023-02-11 19:03:47,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-11 19:03:47,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 9f707008aad36f10c42eb3e971cd2975, server=jenkins-hbase4.apache.org,39279,1676142225989 in 189 msec 2023-02-11 19:03:47,970 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c85ce637d478f3134eeab1bece5f1519 columnFamilyName f1 2023-02-11 19:03:47,970 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(310): Store=c85ce637d478f3134eeab1bece5f1519/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,970 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 250fd9e9a84209694813519eb2c15120; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59959055, jitterRate=-0.10654045641422272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 250fd9e9a84209694813519eb2c15120: Running coprocessor pre-open hook at 1676142227958Writing region info on filesystem at 1676142227958Initializing all the Stores at 1676142227959 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227959Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227959Cleaning up temporary data from old regions at 1676142227966 (+7 ms)Cleaning up detritus from prior splits at 1676142227966Running coprocessor post-open hooks at 1676142227971 (+5 ms)Region opened successfully at 1676142227971 2023-02-11 19:03:47,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, ASSIGN in 355 msec 2023-02-11 19:03:47,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120., pid=30, masterSystemTime=1676142227933 2023-02-11 19:03:47,971 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2 2023-02-11 19:03:47,972 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2 2023-02-11 19:03:47,972 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c85ce637d478f3134eeab1bece5f1519 columnFamilyName f2 2023-02-11 19:03:47,973 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(310): Store=c85ce637d478f3134eeab1bece5f1519/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:47,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00d6e74697fa1ce107080ebe745c736f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 19:03:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:47,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,979 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=250fd9e9a84209694813519eb2c15120, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:47,980 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227979"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142227979"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142227979"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142227979"}]},"ts":"1676142227979"} 2023-02-11 19:03:47,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c85ce637d478f3134eeab1bece5f1519; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63866778, jitterRate=-0.04831084609031677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c85ce637d478f3134eeab1bece5f1519: Running coprocessor pre-open hook at 1676142227967Writing region info on filesystem at 1676142227967Initializing all the Stores at 1676142227968 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227968Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227968Cleaning up temporary data from old regions at 1676142227974 (+6 ms)Cleaning up detritus from prior splits at 1676142227974Running coprocessor post-open hooks at 1676142227980 (+6 ms)Region opened successfully at 1676142227980 2023-02-11 19:03:47,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519., pid=23, masterSystemTime=1676142227928 2023-02-11 19:03:47,982 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1 2023-02-11 19:03:47,982 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1 2023-02-11 19:03:47,982 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00d6e74697fa1ce107080ebe745c736f columnFamilyName f1 2023-02-11 19:03:47,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:47,983 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c85ce637d478f3134eeab1bece5f1519, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:47,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:47,983 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(310): Store=00d6e74697fa1ce107080ebe745c736f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,983 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142227983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142227983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142227983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142227983"}]},"ts":"1676142227983"} 2023-02-11 19:03:47,984 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38416af4cd6d58c860a4d3a6b4583041, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 19:03:47,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-11 19:03:47,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 250fd9e9a84209694813519eb2c15120, server=jenkins-hbase4.apache.org,36693,1676142225955 in 196 msec 2023-02-11 19:03:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,985 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2 2023-02-11 19:03:47,985 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2 2023-02-11 19:03:47,985 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00d6e74697fa1ce107080ebe745c736f columnFamilyName f2 2023-02-11 19:03:47,985 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,986 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(310): Store=00d6e74697fa1ce107080ebe745c736f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,987 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1 2023-02-11 19:03:47,987 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1 2023-02-11 19:03:47,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,987 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38416af4cd6d58c860a4d3a6b4583041 columnFamilyName f1 2023-02-11 19:03:47,988 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(310): Store=38416af4cd6d58c860a4d3a6b4583041/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,988 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, ASSIGN in 369 msec 2023-02-11 19:03:47,990 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2 2023-02-11 19:03:47,990 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2 2023-02-11 19:03:47,991 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38416af4cd6d58c860a4d3a6b4583041 columnFamilyName f2 2023-02-11 19:03:47,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-11 19:03:47,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure c85ce637d478f3134eeab1bece5f1519, server=jenkins-hbase4.apache.org,39279,1676142225989 in 211 msec 2023-02-11 19:03:47,991 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(310): Store=38416af4cd6d58c860a4d3a6b4583041/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:47,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, ASSIGN in 376 msec 2023-02-11 19:03:47,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:47,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:47,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:47,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 00d6e74697fa1ce107080ebe745c736f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68910400, jitterRate=0.02684497833251953}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 00d6e74697fa1ce107080ebe745c736f: Running coprocessor pre-open hook at 1676142227977Writing region info on filesystem at 1676142227977Initializing all the Stores at 1676142227978 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227978Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227978Cleaning up temporary data from old regions at 1676142227988 (+10 ms)Cleaning up detritus from prior splits at 1676142227989 (+1 ms)Running coprocessor post-open hooks at 1676142227996 (+7 ms)Region opened successfully at 1676142227996 2023-02-11 19:03:47,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f., pid=26, masterSystemTime=1676142227933 2023-02-11 19:03:47,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:47,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 38416af4cd6d58c860a4d3a6b4583041; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66986564, jitterRate=-0.0018224120140075684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:47,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 38416af4cd6d58c860a4d3a6b4583041: Running coprocessor pre-open hook at 1676142227984Writing region info on filesystem at 1676142227984Initializing all the Stores at 1676142227985 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227985Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142227985Cleaning up temporary data from old regions at 1676142227993 (+8 ms)Cleaning up detritus from prior splits at 1676142227994 (+1 ms)Running coprocessor post-open hooks at 1676142227998 (+4 ms)Region opened successfully at 1676142227998 2023-02-11 19:03:47,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:47,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:47,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ab3d861e282353c06e89875e8c583f4b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 19:03:47,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041., pid=24, masterSystemTime=1676142227928 2023-02-11 19:03:47,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:47,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:47,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:47,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:48,000 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=00d6e74697fa1ce107080ebe745c736f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,000 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142228000"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142228000"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142228000"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142228000"}]},"ts":"1676142228000"} 2023-02-11 19:03:48,001 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:48,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:48,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:48,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:48,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=38416af4cd6d58c860a4d3a6b4583041, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08195ed3d944596f507693fab589a44d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 19:03:48,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142228001"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142228001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142228001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142228001"}]},"ts":"1676142228001"} 2023-02-11 19:03:48,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:48,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,003 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1 2023-02-11 19:03:48,003 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1 2023-02-11 19:03:48,003 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab3d861e282353c06e89875e8c583f4b columnFamilyName f1 2023-02-11 19:03:48,004 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(310): Store=ab3d861e282353c06e89875e8c583f4b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:48,004 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:48,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-11 19:03:48,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 00d6e74697fa1ce107080ebe745c736f, server=jenkins-hbase4.apache.org,36693,1676142225955 in 221 msec 2023-02-11 19:03:48,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-11 19:03:48,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure 38416af4cd6d58c860a4d3a6b4583041, server=jenkins-hbase4.apache.org,39279,1676142225989 in 225 msec 2023-02-11 19:03:48,005 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2 2023-02-11 19:03:48,005 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2 2023-02-11 19:03:48,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, ASSIGN in 389 msec 2023-02-11 19:03:48,006 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab3d861e282353c06e89875e8c583f4b columnFamilyName f2 2023-02-11 19:03:48,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, ASSIGN in 390 msec 2023-02-11 19:03:48,006 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(310): Store=ab3d861e282353c06e89875e8c583f4b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:48,008 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:48,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:48,009 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1 2023-02-11 19:03:48,009 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1 2023-02-11 19:03:48,009 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08195ed3d944596f507693fab589a44d columnFamilyName f1 2023-02-11 19:03:48,010 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(310): Store=08195ed3d944596f507693fab589a44d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:48,010 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:48,011 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2 2023-02-11 19:03:48,011 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2 2023-02-11 19:03:48,011 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08195ed3d944596f507693fab589a44d columnFamilyName f2 2023-02-11 19:03:48,012 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(310): Store=08195ed3d944596f507693fab589a44d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:48,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:48,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:48,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ab3d861e282353c06e89875e8c583f4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60448551, jitterRate=-0.09924639761447906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:48,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ab3d861e282353c06e89875e8c583f4b: Running coprocessor pre-open hook at 1676142227999Writing region info on filesystem at 1676142227999Initializing all the Stores at 1676142228000 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142228000Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142228001 (+1 ms)Cleaning up temporary data from old regions at 1676142228009 (+8 ms)Cleaning up detritus from prior splits at 1676142228010 (+1 ms)Running coprocessor post-open hooks at 1676142228016 (+6 ms)Region opened successfully at 1676142228016 2023-02-11 19:03:48,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b., pid=27, masterSystemTime=1676142227933 2023-02-11 19:03:48,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:48,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:48,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:48,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:48,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f1f3ec0d707d000241353c40c0e15f85, NAME => 'testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 19:03:48,019 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ab3d861e282353c06e89875e8c583f4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,019 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142228019"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142228019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142228019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142228019"}]},"ts":"1676142228019"} 2023-02-11 19:03:48,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,021 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:48,023 DEBUG [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f1 2023-02-11 19:03:48,023 DEBUG [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f1 2023-02-11 19:03:48,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-11 19:03:48,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure ab3d861e282353c06e89875e8c583f4b, server=jenkins-hbase4.apache.org,36693,1676142225955 in 238 msec 2023-02-11 19:03:48,023 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f3ec0d707d000241353c40c0e15f85 columnFamilyName f1 2023-02-11 19:03:48,024 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(310): Store=f1f3ec0d707d000241353c40c0e15f85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:48,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, ASSIGN in 408 msec 2023-02-11 19:03:48,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:48,024 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08195ed3d944596f507693fab589a44d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72683289, jitterRate=0.08306540548801422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:48,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08195ed3d944596f507693fab589a44d: Running coprocessor pre-open hook at 1676142228002Writing region info on filesystem at 1676142228002Initializing all the Stores at 1676142228004 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142228004Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142228008 (+4 ms)Cleaning up temporary data from old regions at 1676142228015 (+7 ms)Cleaning up detritus from prior splits at 1676142228015Running coprocessor post-open hooks at 1676142228024 (+9 ms)Region opened successfully at 1676142228024 2023-02-11 19:03:48,025 DEBUG [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f2 2023-02-11 19:03:48,025 DEBUG [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f2 2023-02-11 19:03:48,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d., pid=21, masterSystemTime=1676142227928 2023-02-11 19:03:48,025 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f3ec0d707d000241353c40c0e15f85 columnFamilyName f2 2023-02-11 19:03:48,026 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(310): Store=f1f3ec0d707d000241353c40c0e15f85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:48,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=08195ed3d944596f507693fab589a44d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142228027"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142228027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142228027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142228027"}]},"ts":"1676142228027"} 2023-02-11 19:03:48,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:48,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:48,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:48,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:48,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-11 19:03:48,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 08195ed3d944596f507693fab589a44d, server=jenkins-hbase4.apache.org,39279,1676142225989 in 253 msec 2023-02-11 19:03:48,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, ASSIGN in 415 msec 2023-02-11 19:03:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:48,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f1f3ec0d707d000241353c40c0e15f85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63020331, jitterRate=-0.06092388927936554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f1f3ec0d707d000241353c40c0e15f85: Running coprocessor pre-open hook at 1676142228020Writing region info on filesystem at 1676142228020Initializing all the Stores at 1676142228021 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142228021Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142228021Cleaning up temporary data from old regions at 1676142228028 (+7 ms)Cleaning up detritus from prior splits at 1676142228028Running coprocessor post-open hooks at 1676142228032 (+4 ms)Region opened successfully at 1676142228032 2023-02-11 19:03:48,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85., pid=29, masterSystemTime=1676142227933 2023-02-11 19:03:48,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:48,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:48,034 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f1f3ec0d707d000241353c40c0e15f85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,034 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142228034"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142228034"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142228034"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142228034"}]},"ts":"1676142228034"} 2023-02-11 19:03:48,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-11 19:03:48,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure f1f3ec0d707d000241353c40c0e15f85, server=jenkins-hbase4.apache.org,36693,1676142225955 in 251 msec 2023-02-11 19:03:48,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 19:03:48,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, ASSIGN in 422 msec 2023-02-11 19:03:48,038 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:48,038 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142228038"}]},"ts":"1676142228038"} 2023-02-11 19:03:48,039 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-11 19:03:48,041 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:48,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 513 msec 2023-02-11 19:03:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:48,137 INFO [Listener at localhost/36327] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-11 19:03:48,137 DEBUG [Listener at localhost/36327] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-11 19:03:48,137 INFO [Listener at localhost/36327] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:48,139 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-11 19:03:48,140 INFO [Listener at localhost/36327] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:48,140 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-11 19:03:48,140 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:03:48,170 DEBUG [hconnection-0x3b67361e-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:48,195 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39279] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:48,459 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35948, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:48,465 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36693] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:48,494 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:03:48,494 INFO [Listener at localhost/36327] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:03:48,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 19:03:48,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142228495 (current time:1676142228495). 2023-02-11 19:03:48,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:03:48,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] zookeeper.ReadOnlyZKClient(139): Connect 0x506c4623 to 127.0.0.1:59226 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:48,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58c9eca1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:48,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:48,504 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55882, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:48,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x506c4623 to 127.0.0.1:59226 2023-02-11 19:03:48,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:48,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:03:48,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 19:03:48,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 19:03:48,508 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 19:03:48,509 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676142828509 2023-02-11 19:03:48,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 19:03:48,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,512 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:48,513 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 19:03:48,513 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:03:48,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 19:03:48,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-11 19:03:48,514 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 19:03:48,515 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676142828515 2023-02-11 19:03:48,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,527 INFO [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-11 19:03:48,527 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:48,528 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-11 19:03:48,528 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 19:03:48,529 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,529 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,531 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:48,531 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:48,531 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,531 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,531 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,532 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,532 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,536 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-11 19:03:48,536 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:48,536 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39279,1676142225989' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 19:03:48,538 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36693,1676142225955' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 19:03:48,539 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:48,539 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,540 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,540 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:48,540 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,540 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36693,1676142225955' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc8aa93[Count = 1] remaining members to acquire global barrier 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:48,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39279,1676142225989' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 19:03:48,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc8aa93[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:48,543 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 19:03:48,543 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,544 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:48,544 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:48,544 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:48,544 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:48,544 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. started... 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. started... 2023-02-11 19:03:48,545 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:48,545 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. started... 2023-02-11 19:03:48,546 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c85ce637d478f3134eeab1bece5f1519 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:48,544 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. started... 2023-02-11 19:03:48,546 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegion(2744): Flushing acf9c9b53025adcced4cf9882c5cf898 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:48,545 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:48,547 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 250fd9e9a84209694813519eb2c15120 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:48,545 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. started... 2023-02-11 19:03:48,545 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 19:03:48,548 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:48,545 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 19:03:48,549 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:48,545 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 38416af4cd6d58c860a4d3a6b4583041 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 19:03:48,548 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 00d6e74697fa1ce107080ebe745c736f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:48,547 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. started... 2023-02-11 19:03:48,550 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f1f3ec0d707d000241353c40c0e15f85: 2023-02-11 19:03:48,550 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,550 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,551 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:48,551 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:48,578 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. completed. 2023-02-11 19:03:48,578 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:48,578 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:48,578 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 19:03:48,578 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. started... 2023-02-11 19:03:48,578 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f1/af699b641f9d47cba9ecb922d9b0a330 2023-02-11 19:03:48,580 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f1/30ca42a9be2745309b93c1524c74ab42 2023-02-11 19:03:48,589 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ab3d861e282353c06e89875e8c583f4b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:48,596 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f1/a96cf28bf84347debc8d66e84cdde5d9 2023-02-11 19:03:48,598 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd 2023-02-11 19:03:48,609 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f1/3eb1a38942ce48d18d9affd030c1343e 2023-02-11 19:03:48,614 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:48,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 19:03:48,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:48,616 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:03:48,636 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f2/c90af635102b49f481825919979378b8 2023-02-11 19:03:48,637 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f2/9301f9f35c424586b8e1915ff2cf750a 2023-02-11 19:03:48,640 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f1/f874e1958780475988eaf4c7f6ddaac1 2023-02-11 19:03:48,652 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f1/af699b641f9d47cba9ecb922d9b0a330 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/af699b641f9d47cba9ecb922d9b0a330 2023-02-11 19:03:48,656 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f1/30ca42a9be2745309b93c1524c74ab42 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/30ca42a9be2745309b93c1524c74ab42 2023-02-11 19:03:48,657 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/af699b641f9d47cba9ecb922d9b0a330, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,658 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f2/9301f9f35c424586b8e1915ff2cf750a as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/9301f9f35c424586b8e1915ff2cf750a 2023-02-11 19:03:48,663 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/9301f9f35c424586b8e1915ff2cf750a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,664 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 250fd9e9a84209694813519eb2c15120 in 117ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,664 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-11 19:03:48,665 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 250fd9e9a84209694813519eb2c15120: 2023-02-11 19:03:48,665 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,665 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,665 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/af699b641f9d47cba9ecb922d9b0a330] hfiles 2023-02-11 19:03:48,665 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/af699b641f9d47cba9ecb922d9b0a330 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,666 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/9301f9f35c424586b8e1915ff2cf750a] hfiles 2023-02-11 19:03:48,666 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/9301f9f35c424586b8e1915ff2cf750a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,671 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f2/4a1061cd9b5c45a09e65970439f033ab 2023-02-11 19:03:48,672 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f2/4adfb712d69a491c9dc64f0cc6fbccaf 2023-02-11 19:03:48,676 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/30ca42a9be2745309b93c1524c74ab42, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:48,676 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f2/1aa39970106a410a85a7ff81e3fcefd9 2023-02-11 19:03:48,678 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f2/c90af635102b49f481825919979378b8 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/c90af635102b49f481825919979378b8 2023-02-11 19:03:48,681 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f1/a96cf28bf84347debc8d66e84cdde5d9 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/a96cf28bf84347debc8d66e84cdde5d9 2023-02-11 19:03:48,683 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/c90af635102b49f481825919979378b8, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:48,683 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd 2023-02-11 19:03:48,683 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 38416af4cd6d58c860a4d3a6b4583041 in 138ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,685 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 38416af4cd6d58c860a4d3a6b4583041: 2023-02-11 19:03:48,685 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. completed. 2023-02-11 19:03:48,685 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:48,685 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 19:03:48,685 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. started... 2023-02-11 19:03:48,688 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 017c1ac7e61aee05e086a4f402774949: 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/30ca42a9be2745309b93c1524c74ab42] hfiles 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/30ca42a9be2745309b93c1524c74ab42 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/c90af635102b49f481825919979378b8] hfiles 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f1/3eb1a38942ce48d18d9affd030c1343e as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/3eb1a38942ce48d18d9affd030c1343e 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/c90af635102b49f481825919979378b8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,689 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 19:03:48,694 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/a96cf28bf84347debc8d66e84cdde5d9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,695 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f2/4a1061cd9b5c45a09e65970439f033ab as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/4a1061cd9b5c45a09e65970439f033ab 2023-02-11 19:03:48,697 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,698 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f2/4adfb712d69a491c9dc64f0cc6fbccaf as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/4adfb712d69a491c9dc64f0cc6fbccaf 2023-02-11 19:03:48,698 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/3eb1a38942ce48d18d9affd030c1343e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,698 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f2/1aa39970106a410a85a7ff81e3fcefd9 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/1aa39970106a410a85a7ff81e3fcefd9 2023-02-11 19:03:48,701 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/4a1061cd9b5c45a09e65970439f033ab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,702 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for acf9c9b53025adcced4cf9882c5cf898 in 156ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for acf9c9b53025adcced4cf9882c5cf898: 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/a96cf28bf84347debc8d66e84cdde5d9] hfiles 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/a96cf28bf84347debc8d66e84cdde5d9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/4a1061cd9b5c45a09e65970439f033ab] hfiles 2023-02-11 19:03:48,702 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/4a1061cd9b5c45a09e65970439f033ab for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,703 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/4adfb712d69a491c9dc64f0cc6fbccaf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,704 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 00d6e74697fa1ce107080ebe745c736f in 156ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,704 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. completed. 2023-02-11 19:03:48,704 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:48,704 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 00d6e74697fa1ce107080ebe745c736f: 2023-02-11 19:03:48,704 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 19:03:48,704 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,704 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,705 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd] hfiles 2023-02-11 19:03:48,705 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,705 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/4adfb712d69a491c9dc64f0cc6fbccaf] hfiles 2023-02-11 19:03:48,705 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/4adfb712d69a491c9dc64f0cc6fbccaf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,706 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/1aa39970106a410a85a7ff81e3fcefd9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,707 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c85ce637d478f3134eeab1bece5f1519 in 161ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c85ce637d478f3134eeab1bece5f1519: 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/3eb1a38942ce48d18d9affd030c1343e] hfiles 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/3eb1a38942ce48d18d9affd030c1343e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/1aa39970106a410a85a7ff81e3fcefd9] hfiles 2023-02-11 19:03:48,707 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/1aa39970106a410a85a7ff81e3fcefd9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,712 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. completed. 2023-02-11 19:03:48,712 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:48,712 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:48,712 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 19:03:48,712 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. started... 2023-02-11 19:03:48,713 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 08195ed3d944596f507693fab589a44d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 19:03:48,714 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. completed. 2023-02-11 19:03:48,714 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:48,715 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. completed. 2023-02-11 19:03:48,715 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:48,715 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:48,715 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 19:03:48,715 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 19:03:48,715 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. started... 2023-02-11 19:03:48,716 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9f707008aad36f10c42eb3e971cd2975 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 19:03:48,727 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f1/7495ee15cfb24b8e9ebad9c393b621e4 2023-02-11 19:03:48,728 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f1/89d234b0059d4dc8a53304acc6c60276 2023-02-11 19:03:48,744 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f2/25f3dfb64a764d4dae2a87aabecccec7 2023-02-11 19:03:48,748 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f1/7495ee15cfb24b8e9ebad9c393b621e4 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/7495ee15cfb24b8e9ebad9c393b621e4 2023-02-11 19:03:48,750 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f2/8e350fad6dd94fc4990937ecc1cf794c 2023-02-11 19:03:48,752 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/7495ee15cfb24b8e9ebad9c393b621e4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:48,753 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f2/25f3dfb64a764d4dae2a87aabecccec7 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/25f3dfb64a764d4dae2a87aabecccec7 2023-02-11 19:03:48,754 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f1/89d234b0059d4dc8a53304acc6c60276 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/89d234b0059d4dc8a53304acc6c60276 2023-02-11 19:03:48,760 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/25f3dfb64a764d4dae2a87aabecccec7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 19:03:48,761 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/89d234b0059d4dc8a53304acc6c60276, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,761 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 08195ed3d944596f507693fab589a44d in 48ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 08195ed3d944596f507693fab589a44d: 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/7495ee15cfb24b8e9ebad9c393b621e4] hfiles 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/7495ee15cfb24b8e9ebad9c393b621e4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f2/8e350fad6dd94fc4990937ecc1cf794c as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/8e350fad6dd94fc4990937ecc1cf794c 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/25f3dfb64a764d4dae2a87aabecccec7] hfiles 2023-02-11 19:03:48,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/25f3dfb64a764d4dae2a87aabecccec7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,767 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/8e350fad6dd94fc4990937ecc1cf794c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:48,768 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9f707008aad36f10c42eb3e971cd2975 in 52ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9f707008aad36f10c42eb3e971cd2975: 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/89d234b0059d4dc8a53304acc6c60276] hfiles 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/89d234b0059d4dc8a53304acc6c60276 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/8e350fad6dd94fc4990937ecc1cf794c] hfiles 2023-02-11 19:03:48,768 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/8e350fad6dd94fc4990937ecc1cf794c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:48,772 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. completed. 2023-02-11 19:03:48,772 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:48,772 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 19:03:48,776 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. completed. 2023-02-11 19:03:48,776 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:48,776 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 19:03:48,816 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:48,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 19:03:48,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:48,818 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:03:49,094 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f2/56b9d9fae9f94c0889b603f4891f638d 2023-02-11 19:03:49,100 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f1/f874e1958780475988eaf4c7f6ddaac1 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/f874e1958780475988eaf4c7f6ddaac1 2023-02-11 19:03:49,103 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. completed. 2023-02-11 19:03:49,103 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 19:03:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 19:03:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 19:03:49,103 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,39279,1676142225989' in zk 2023-02-11 19:03:49,104 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/f874e1958780475988eaf4c7f6ddaac1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:49,105 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f2/56b9d9fae9f94c0889b603f4891f638d as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/56b9d9fae9f94c0889b603f4891f638d 2023-02-11 19:03:49,105 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,105 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 19:03:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,105 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:49,105 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 19:03:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:49,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,39279,1676142225989': 2023-02-11 19:03:49,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39279,1676142225989' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 19:03:49,110 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/56b9d9fae9f94c0889b603f4891f638d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 19:03:49,111 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ab3d861e282353c06e89875e8c583f4b in 522ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ab3d861e282353c06e89875e8c583f4b: 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/f874e1958780475988eaf4c7f6ddaac1] hfiles 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/f874e1958780475988eaf4c7f6ddaac1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/56b9d9fae9f94c0889b603f4891f638d] hfiles 2023-02-11 19:03:49,111 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/56b9d9fae9f94c0889b603f4891f638d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,117 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. completed. 2023-02-11 19:03:49,117 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:49,118 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 19:03:49,118 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 19:03:49,118 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,118 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 19:03:49,118 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36693,1676142225955' in zk 2023-02-11 19:03:49,118 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:49,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 19:03:49,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:49,120 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 19:03:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 19:03:49,120 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 19:03:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:49,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:49,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36693,1676142225955': 2023-02-11 19:03:49,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36693,1676142225955' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 19:03:49,123 INFO [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-11 19:03:49,123 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:49,123 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:49,123 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,123 INFO [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:03:49,125 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:49,125 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:49,125 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,126 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,127 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,127 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:49,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:49,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:49,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:49,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,132 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:49,132 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,133 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,133 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,133 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,133 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:49,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:49,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-11 19:03:49,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,180 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676142228509Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676142229133 (+624 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676142229133Writing data manifest for testWithMockedMapReduceMultiRegion at 1676142229141 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676142229154 (+13 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676142229179 (+25 ms) 2023-02-11 19:03:49,181 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 19:03:49,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 670 msec 2023-02-11 19:03:49,620 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:49,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 19:03:49,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:03:49,622 INFO [Listener at localhost/36327] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:03:49,626 INFO [Listener at localhost/36327] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:03:49,631 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:03:49,655 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36693] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:49,665 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39279] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:49,731 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:03:49,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:03:49,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,741 INFO [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-11 19:03:49,741 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:49,742 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-11 19:03:49,742 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 19:03:49,742 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,742 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,744 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:49,744 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:49,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:49,744 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,744 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,744 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,745 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,745 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,752 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-11 19:03:49,752 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:49,752 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-11 19:03:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 19:03:49,754 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 19:03:49,756 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:49,756 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. started... 2023-02-11 19:03:49,756 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 250fd9e9a84209694813519eb2c15120 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:49,756 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:49,756 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. started... 2023-02-11 19:03:49,756 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. started... 2023-02-11 19:03:49,757 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38416af4cd6d58c860a4d3a6b4583041 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 19:03:49,757 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 19:03:49,757 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:49,757 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 00d6e74697fa1ce107080ebe745c736f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. started... 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f1f3ec0d707d000241353c40c0e15f85: 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:49,757 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. started... 2023-02-11 19:03:49,757 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c85ce637d478f3134eeab1bece5f1519 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 19:03:49,761 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:49,760 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:49,760 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 19:03:49,761 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. started... 2023-02-11 19:03:49,761 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. started... 2023-02-11 19:03:49,762 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ab3d861e282353c06e89875e8c583f4b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:49,762 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing acf9c9b53025adcced4cf9882c5cf898 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:49,799 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f1/03385efb0b3344db91f27205ca96ded7 2023-02-11 19:03:49,799 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f1/08f70570b26444eba345a174a28e7679 2023-02-11 19:03:49,801 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f1/715b44d871f84b90988cbd1142612ac2 2023-02-11 19:03:49,801 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f1/d7fe0fa07af540ab9e445d1a2379d914 2023-02-11 19:03:49,802 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f1/03995be421af49fe8212f0beb97a464d 2023-02-11 19:03:49,804 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f1/7e24b53c9021423e84e99f3630359382 2023-02-11 19:03:49,864 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f2/b14f74010919425196266ea4ce923696 2023-02-11 19:03:49,864 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f2/254aa078217a412b9a9d53c125d02f09 2023-02-11 19:03:49,865 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f2/46eb75e604fd425aaa16c7c65db8fd59 2023-02-11 19:03:49,867 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f2/748a6ae48bb847a1baccfddfe29d8700 2023-02-11 19:03:49,868 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f2/6384b59d261741cdb743886c004b936a 2023-02-11 19:03:49,870 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f2/610c872fcfc54b5e9ec0d51153dc4b4a 2023-02-11 19:03:49,875 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f1/d7fe0fa07af540ab9e445d1a2379d914 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/d7fe0fa07af540ab9e445d1a2379d914 2023-02-11 19:03:49,876 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f1/03995be421af49fe8212f0beb97a464d as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/03995be421af49fe8212f0beb97a464d 2023-02-11 19:03:49,877 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f1/08f70570b26444eba345a174a28e7679 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/08f70570b26444eba345a174a28e7679 2023-02-11 19:03:49,878 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f1/7e24b53c9021423e84e99f3630359382 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/7e24b53c9021423e84e99f3630359382 2023-02-11 19:03:49,879 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f1/715b44d871f84b90988cbd1142612ac2 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/715b44d871f84b90988cbd1142612ac2 2023-02-11 19:03:49,880 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f1/03385efb0b3344db91f27205ca96ded7 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/03385efb0b3344db91f27205ca96ded7 2023-02-11 19:03:49,884 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/d7fe0fa07af540ab9e445d1a2379d914, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,886 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/.tmp/f2/254aa078217a412b9a9d53c125d02f09 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/254aa078217a412b9a9d53c125d02f09 2023-02-11 19:03:49,887 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/7e24b53c9021423e84e99f3630359382, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,887 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/08f70570b26444eba345a174a28e7679, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,888 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/03385efb0b3344db91f27205ca96ded7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,889 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/.tmp/f2/6384b59d261741cdb743886c004b936a as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/6384b59d261741cdb743886c004b936a 2023-02-11 19:03:49,890 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/.tmp/f2/46eb75e604fd425aaa16c7c65db8fd59 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/46eb75e604fd425aaa16c7c65db8fd59 2023-02-11 19:03:49,890 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/03995be421af49fe8212f0beb97a464d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:49,890 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/715b44d871f84b90988cbd1142612ac2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,891 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/.tmp/f2/748a6ae48bb847a1baccfddfe29d8700 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/748a6ae48bb847a1baccfddfe29d8700 2023-02-11 19:03:49,891 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/.tmp/f2/b14f74010919425196266ea4ce923696 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/b14f74010919425196266ea4ce923696 2023-02-11 19:03:49,893 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/.tmp/f2/610c872fcfc54b5e9ec0d51153dc4b4a as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/610c872fcfc54b5e9ec0d51153dc4b4a 2023-02-11 19:03:49,902 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/46eb75e604fd425aaa16c7c65db8fd59, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,902 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/b14f74010919425196266ea4ce923696, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:49,903 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 38416af4cd6d58c860a4d3a6b4583041 in 147ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,903 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c85ce637d478f3134eeab1bece5f1519 in 146ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,903 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38416af4cd6d58c860a4d3a6b4583041: 2023-02-11 19:03:49,903 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c85ce637d478f3134eeab1bece5f1519: 2023-02-11 19:03:49,903 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:49,903 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:49,904 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:49,904 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. started... 2023-02-11 19:03:49,904 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 08195ed3d944596f507693fab589a44d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 19:03:49,913 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:49,913 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 19:03:49,913 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 19:03:49,913 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. started... 2023-02-11 19:03:49,914 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/748a6ae48bb847a1baccfddfe29d8700, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,914 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/254aa078217a412b9a9d53c125d02f09, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,914 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9f707008aad36f10c42eb3e971cd2975 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 19:03:49,915 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/610c872fcfc54b5e9ec0d51153dc4b4a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,916 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ab3d861e282353c06e89875e8c583f4b in 154ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,916 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 250fd9e9a84209694813519eb2c15120 in 160ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 250fd9e9a84209694813519eb2c15120: 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ab3d861e282353c06e89875e8c583f4b: 2023-02-11 19:03:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 19:03:49,916 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for acf9c9b53025adcced4cf9882c5cf898 in 154ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for acf9c9b53025adcced4cf9882c5cf898: 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. started... 2023-02-11 19:03:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 017c1ac7e61aee05e086a4f402774949: 2023-02-11 19:03:49,916 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 19:03:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 19:03:49,918 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/6384b59d261741cdb743886c004b936a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,921 INFO [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 00d6e74697fa1ce107080ebe745c736f in 164ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,921 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 00d6e74697fa1ce107080ebe745c736f: 2023-02-11 19:03:49,921 DEBUG [rs(jenkins-hbase4.apache.org,36693,1676142225955)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 19:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 19:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 19:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36693,1676142225955' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 19:03:49,931 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f1/3c12b89645084f99b3c38344ec64eaa7 2023-02-11 19:03:49,934 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f1/63f2d0be2b2b4838908a923116e607aa 2023-02-11 19:03:49,952 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f2/085c7afc61c1453ca28c578b3b0edaa5 2023-02-11 19:03:49,956 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f1/3c12b89645084f99b3c38344ec64eaa7 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/3c12b89645084f99b3c38344ec64eaa7 2023-02-11 19:03:49,959 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f2/e040c4d0d569490eaa8597a7c0c8289f 2023-02-11 19:03:49,961 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/3c12b89645084f99b3c38344ec64eaa7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:49,962 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/.tmp/f2/085c7afc61c1453ca28c578b3b0edaa5 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/085c7afc61c1453ca28c578b3b0edaa5 2023-02-11 19:03:49,964 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f1/63f2d0be2b2b4838908a923116e607aa as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/63f2d0be2b2b4838908a923116e607aa 2023-02-11 19:03:49,967 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/085c7afc61c1453ca28c578b3b0edaa5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 19:03:49,968 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 08195ed3d944596f507693fab589a44d in 64ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,968 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 08195ed3d944596f507693fab589a44d: 2023-02-11 19:03:49,968 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:49,968 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 19:03:49,969 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/63f2d0be2b2b4838908a923116e607aa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,969 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/.tmp/f2/e040c4d0d569490eaa8597a7c0c8289f as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/e040c4d0d569490eaa8597a7c0c8289f 2023-02-11 19:03:49,973 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/e040c4d0d569490eaa8597a7c0c8289f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 19:03:49,973 INFO [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9f707008aad36f10c42eb3e971cd2975 in 60ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:49,974 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9f707008aad36f10c42eb3e971cd2975: 2023-02-11 19:03:49,974 DEBUG [rs(jenkins-hbase4.apache.org,39279,1676142225989)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:49,974 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 19:03:49,974 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 19:03:49,974 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:49,974 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 19:03:49,974 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39279,1676142225989' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 19:03:49,996 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:50,079 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:50,079 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,079 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,080 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:50,080 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,080 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:50,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:50,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36693,1676142225955' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bf735b2[Count = 1] remaining members to acquire global barrier 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:50,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39279,1676142225989' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 19:03:50,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bf735b2[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:50,083 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 19:03:50,083 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,156 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,156 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,157 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 19:03:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 19:03:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,39279,1676142225989' in zk 2023-02-11 19:03:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 19:03:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36693,1676142225955' in zk 2023-02-11 19:03:50,157 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,157 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:50,249 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 19:03:50,249 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 19:03:50,249 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:50,249 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,249 DEBUG [member: 'jenkins-hbase4.apache.org,39279,1676142225989' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 19:03:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:50,249 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:50,249 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,249 DEBUG [member: 'jenkins-hbase4.apache.org,36693,1676142225955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 19:03:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,39279,1676142225989': 2023-02-11 19:03:50,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39279,1676142225989' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 19:03:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36693,1676142225955': 2023-02-11 19:03:50,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36693,1676142225955' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 19:03:50,255 INFO [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-11 19:03:50,255 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:50,255 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:50,255 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,255 INFO [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:03:50,310 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,310 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,310 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:50,310 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:50,310 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:50,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:50,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:50,311 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,312 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,313 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:50,313 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,372 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,372 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:50,372 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:50,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:50,372 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:50,372 DEBUG [(jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:50,372 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-11 19:03:50,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:03:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:50,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:50,372 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:03:50,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:50,373 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:50,374 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,473 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:03:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:03:50,479 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676142228495 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:50,480 DEBUG [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:50,480 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=00d6e74697fa1ce107080ebe745c736f as 00d6e74697fa1ce107080ebe745c736f in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=250fd9e9a84209694813519eb2c15120 as 250fd9e9a84209694813519eb2c15120 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=38416af4cd6d58c860a4d3a6b4583041 as 38416af4cd6d58c860a4d3a6b4583041 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=f1f3ec0d707d000241353c40c0e15f85 as f1f3ec0d707d000241353c40c0e15f85 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=c85ce637d478f3134eeab1bece5f1519 as c85ce637d478f3134eeab1bece5f1519 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=acf9c9b53025adcced4cf9882c5cf898 as acf9c9b53025adcced4cf9882c5cf898 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=08195ed3d944596f507693fab589a44d as 08195ed3d944596f507693fab589a44d in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=ab3d861e282353c06e89875e8c583f4b as ab3d861e282353c06e89875e8c583f4b in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=017c1ac7e61aee05e086a4f402774949 as 017c1ac7e61aee05e086a4f402774949 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,481 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=9f707008aad36f10c42eb3e971cd2975 as 9f707008aad36f10c42eb3e971cd2975 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,482 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c85ce637d478f3134eeab1bece5f1519, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,482 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ab3d861e282353c06e89875e8c583f4b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,482 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 08195ed3d944596f507693fab589a44d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,483 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => acf9c9b53025adcced4cf9882c5cf898, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,483 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 00d6e74697fa1ce107080ebe745c736f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,483 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f1f3ec0d707d000241353c40c0e15f85, NAME => 'testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,483 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 38416af4cd6d58c860a4d3a6b4583041, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,483 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 250fd9e9a84209694813519eb2c15120, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,515 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,515 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f874e1958780475988eaf4c7f6ddaac1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,520 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,520 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a1b8e8eef524e3eb8dbd7881cf5dacd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,524 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,524 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3eb1a38942ce48d18d9affd030c1343e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,525 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 56b9d9fae9f94c0889b603f4891f638d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,532 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,532 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a96cf28bf84347debc8d66e84cdde5d9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,532 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4adfb712d69a491c9dc64f0cc6fbccaf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,532 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,533 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 30ca42a9be2745309b93c1524c74ab42 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,533 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1aa39970106a410a85a7ff81e3fcefd9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,533 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ab3d861e282353c06e89875e8c583f4b, disabling compactions & flushes 2023-02-11 19:03:50,533 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:50,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:50,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. after waiting 0 ms 2023-02-11 19:03:50,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:50,534 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:50,534 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ab3d861e282353c06e89875e8c583f4b: Waiting for close lock at 1676142230533Disabling compacts and flushes for region at 1676142230533Disabling writes for close at 1676142230534 (+1 ms)Writing region close event to WAL at 1676142230534Closed at 1676142230534 2023-02-11 19:03:50,534 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 017c1ac7e61aee05e086a4f402774949, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,535 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,535 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f1f3ec0d707d000241353c40c0e15f85, disabling compactions & flushes 2023-02-11 19:03:50,535 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:50,535 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:50,535 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. after waiting 0 ms 2023-02-11 19:03:50,535 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:50,536 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:50,536 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f1f3ec0d707d000241353c40c0e15f85: Waiting for close lock at 1676142230535Disabling compacts and flushes for region at 1676142230535Disabling writes for close at 1676142230535Writing region close event to WAL at 1676142230536 (+1 ms)Closed at 1676142230536 2023-02-11 19:03:50,536 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9f707008aad36f10c42eb3e971cd2975, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,537 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,537 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,537 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af699b641f9d47cba9ecb922d9b0a330 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,537 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7495ee15cfb24b8e9ebad9c393b621e4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,542 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c90af635102b49f481825919979378b8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,543 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9301f9f35c424586b8e1915ff2cf750a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,543 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c85ce637d478f3134eeab1bece5f1519, disabling compactions & flushes 2023-02-11 19:03:50,543 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:50,543 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:50,543 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. after waiting 0 ms 2023-02-11 19:03:50,543 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:50,543 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:50,543 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c85ce637d478f3134eeab1bece5f1519: Waiting for close lock at 1676142230543Disabling compacts and flushes for region at 1676142230543Disabling writes for close at 1676142230543Writing region close event to WAL at 1676142230543Closed at 1676142230543 2023-02-11 19:03:50,544 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 25f3dfb64a764d4dae2a87aabecccec7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 00d6e74697fa1ce107080ebe745c736f, disabling compactions & flushes 2023-02-11 19:03:50,551 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:50,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:50,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. after waiting 0 ms 2023-02-11 19:03:50,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:50,551 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:50,551 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 00d6e74697fa1ce107080ebe745c736f: Waiting for close lock at 1676142230551Disabling compacts and flushes for region at 1676142230551Disabling writes for close at 1676142230551Writing region close event to WAL at 1676142230551Closed at 1676142230551 2023-02-11 19:03:50,551 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4a1061cd9b5c45a09e65970439f033ab from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,551 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 38416af4cd6d58c860a4d3a6b4583041, disabling compactions & flushes 2023-02-11 19:03:50,552 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. after waiting 0 ms 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:50,552 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 38416af4cd6d58c860a4d3a6b4583041: Waiting for close lock at 1676142230551Disabling compacts and flushes for region at 1676142230551Disabling writes for close at 1676142230552 (+1 ms)Writing region close event to WAL at 1676142230552Closed at 1676142230552 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 08195ed3d944596f507693fab589a44d, disabling compactions & flushes 2023-02-11 19:03:50,552 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. after waiting 0 ms 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:50,552 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 08195ed3d944596f507693fab589a44d: Waiting for close lock at 1676142230552Disabling compacts and flushes for region at 1676142230552Disabling writes for close at 1676142230552Writing region close event to WAL at 1676142230552Closed at 1676142230552 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 250fd9e9a84209694813519eb2c15120, disabling compactions & flushes 2023-02-11 19:03:50,552 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:50,552 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. after waiting 0 ms 2023-02-11 19:03:50,553 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:50,553 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:50,553 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 250fd9e9a84209694813519eb2c15120: Waiting for close lock at 1676142230552Disabling compacts and flushes for region at 1676142230552Disabling writes for close at 1676142230553 (+1 ms)Writing region close event to WAL at 1676142230553Closed at 1676142230553 2023-02-11 19:03:50,554 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing acf9c9b53025adcced4cf9882c5cf898, disabling compactions & flushes 2023-02-11 19:03:50,554 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:50,554 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:50,554 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. after waiting 0 ms 2023-02-11 19:03:50,554 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:50,554 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:50,554 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for acf9c9b53025adcced4cf9882c5cf898: Waiting for close lock at 1676142230554Disabling compacts and flushes for region at 1676142230554Disabling writes for close at 1676142230554Writing region close event to WAL at 1676142230554Closed at 1676142230554 2023-02-11 19:03:50,555 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,555 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 89d234b0059d4dc8a53304acc6c60276 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:50,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 017c1ac7e61aee05e086a4f402774949, disabling compactions & flushes 2023-02-11 19:03:50,556 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:50,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:50,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. after waiting 0 ms 2023-02-11 19:03:50,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:50,556 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:50,556 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 017c1ac7e61aee05e086a4f402774949: Waiting for close lock at 1676142230556Disabling compacts and flushes for region at 1676142230556Disabling writes for close at 1676142230556Writing region close event to WAL at 1676142230556Closed at 1676142230556 2023-02-11 19:03:50,557 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8e350fad6dd94fc4990937ecc1cf794c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:50,558 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9f707008aad36f10c42eb3e971cd2975, disabling compactions & flushes 2023-02-11 19:03:50,558 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:50,558 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:50,558 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. after waiting 0 ms 2023-02-11 19:03:50,558 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:50,558 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:50,558 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9f707008aad36f10c42eb3e971cd2975: Waiting for close lock at 1676142230558Disabling compacts and flushes for region at 1676142230558Disabling writes for close at 1676142230558Writing region close event to WAL at 1676142230558Closed at 1676142230558 2023-02-11 19:03:50,559 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676142228495 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:50,559 DEBUG [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,559 DEBUG [Listener at localhost/36327] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9 2023-02-11 19:03:50,559 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-data/ 2023-02-11 19:03:50,560 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----default/ 2023-02-11 19:03:50,560 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-11 19:03:50,561 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------00d6e74697fa1ce107080ebe745c736f/ 2023-02-11 19:03:50,561 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,561 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,561 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=00d6e74697fa1ce107080ebe745c736f-5a1b8e8eef524e3eb8dbd7881cf5dacd 2023-02-11 19:03:50,561 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,562 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=00d6e74697fa1ce107080ebe745c736f-4adfb712d69a491c9dc64f0cc6fbccaf 2023-02-11 19:03:50,562 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------017c1ac7e61aee05e086a4f402774949/ 2023-02-11 19:03:50,562 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,562 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------08195ed3d944596f507693fab589a44d/ 2023-02-11 19:03:50,562 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,562 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,563 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=08195ed3d944596f507693fab589a44d-7495ee15cfb24b8e9ebad9c393b621e4 2023-02-11 19:03:50,563 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,563 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=08195ed3d944596f507693fab589a44d-25f3dfb64a764d4dae2a87aabecccec7 2023-02-11 19:03:50,563 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------250fd9e9a84209694813519eb2c15120/ 2023-02-11 19:03:50,563 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,563 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,564 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=250fd9e9a84209694813519eb2c15120-af699b641f9d47cba9ecb922d9b0a330 2023-02-11 19:03:50,564 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,564 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=250fd9e9a84209694813519eb2c15120-9301f9f35c424586b8e1915ff2cf750a 2023-02-11 19:03:50,564 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------38416af4cd6d58c860a4d3a6b4583041/ 2023-02-11 19:03:50,565 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,565 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,565 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=38416af4cd6d58c860a4d3a6b4583041-30ca42a9be2745309b93c1524c74ab42 2023-02-11 19:03:50,565 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,565 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=38416af4cd6d58c860a4d3a6b4583041-c90af635102b49f481825919979378b8 2023-02-11 19:03:50,565 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------9f707008aad36f10c42eb3e971cd2975/ 2023-02-11 19:03:50,566 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,566 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,566 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9f707008aad36f10c42eb3e971cd2975-89d234b0059d4dc8a53304acc6c60276 2023-02-11 19:03:50,566 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,566 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9f707008aad36f10c42eb3e971cd2975-8e350fad6dd94fc4990937ecc1cf794c 2023-02-11 19:03:50,566 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------ab3d861e282353c06e89875e8c583f4b/ 2023-02-11 19:03:50,567 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,567 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,567 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ab3d861e282353c06e89875e8c583f4b-f874e1958780475988eaf4c7f6ddaac1 2023-02-11 19:03:50,567 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,567 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ab3d861e282353c06e89875e8c583f4b-56b9d9fae9f94c0889b603f4891f638d 2023-02-11 19:03:50,567 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------acf9c9b53025adcced4cf9882c5cf898/ 2023-02-11 19:03:50,568 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,568 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,568 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=acf9c9b53025adcced4cf9882c5cf898-a96cf28bf84347debc8d66e84cdde5d9 2023-02-11 19:03:50,568 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,568 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=acf9c9b53025adcced4cf9882c5cf898-4a1061cd9b5c45a09e65970439f033ab 2023-02-11 19:03:50,568 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------c85ce637d478f3134eeab1bece5f1519/ 2023-02-11 19:03:50,569 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,569 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:50,569 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c85ce637d478f3134eeab1bece5f1519-3eb1a38942ce48d18d9affd030c1343e 2023-02-11 19:03:50,569 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:50,569 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c85ce637d478f3134eeab1bece5f1519-1aa39970106a410a85a7ff81e3fcefd9 2023-02-11 19:03:50,569 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------f1f3ec0d707d000241353c40c0e15f85/ 2023-02-11 19:03:50,570 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:50,573 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 19:03:51,225 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,225 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,227 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,229 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:51,230 DEBUG [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f1 2023-02-11 19:03:51,231 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 017c1ac7e61aee05e086a4f402774949 columnFamilyName f1 2023-02-11 19:03:51,231 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(310): Store=017c1ac7e61aee05e086a4f402774949/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,231 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:51,232 DEBUG [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f2 2023-02-11 19:03:51,233 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 017c1ac7e61aee05e086a4f402774949 columnFamilyName f2 2023-02-11 19:03:51,233 INFO [StoreOpener-017c1ac7e61aee05e086a4f402774949-1] regionserver.HStore(310): Store=017c1ac7e61aee05e086a4f402774949/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,233 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,233 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened 017c1ac7e61aee05e086a4f402774949; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73970145, jitterRate=0.10224105417728424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,233 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for 017c1ac7e61aee05e086a4f402774949: Writing region info on filesystem at 1676142231227Initializing all the Stores at 1676142231228 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231228Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231228Region opened successfully at 1676142231233 (+5 ms) 2023-02-11 19:03:51,234 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing 017c1ac7e61aee05e086a4f402774949, disabling compactions & flushes 2023-02-11 19:03:51,234 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,234 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,234 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. after waiting 0 ms 2023-02-11 19:03:51,234 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,234 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,234 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for 017c1ac7e61aee05e086a4f402774949: Waiting for close lock at 1676142231234Disabling compacts and flushes for region at 1676142231234Disabling writes for close at 1676142231234Writing region close event to WAL at 1676142231234Closed at 1676142231234 2023-02-11 19:03:51,235 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,235 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,236 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,237 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:51,238 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1 2023-02-11 19:03:51,238 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00d6e74697fa1ce107080ebe745c736f columnFamilyName f1 2023-02-11 19:03:51,242 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/testWithMockedMapReduceMultiRegion=00d6e74697fa1ce107080ebe745c736f-5a1b8e8eef524e3eb8dbd7881cf5dacd 2023-02-11 19:03:51,242 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(310): Store=00d6e74697fa1ce107080ebe745c736f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,242 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:51,243 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2 2023-02-11 19:03:51,243 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00d6e74697fa1ce107080ebe745c736f columnFamilyName f2 2023-02-11 19:03:51,247 DEBUG [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/testWithMockedMapReduceMultiRegion=00d6e74697fa1ce107080ebe745c736f-4adfb712d69a491c9dc64f0cc6fbccaf 2023-02-11 19:03:51,247 INFO [StoreOpener-00d6e74697fa1ce107080ebe745c736f-1] regionserver.HStore(310): Store=00d6e74697fa1ce107080ebe745c736f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,247 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,247 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened 00d6e74697fa1ce107080ebe745c736f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64658341, jitterRate=-0.03651563823223114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,247 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for 00d6e74697fa1ce107080ebe745c736f: Writing region info on filesystem at 1676142231236Initializing all the Stores at 1676142231236Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231237 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231237Region opened successfully at 1676142231247 (+10 ms) 2023-02-11 19:03:51,256 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing 00d6e74697fa1ce107080ebe745c736f, disabling compactions & flushes 2023-02-11 19:03:51,257 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,258 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,258 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. after waiting 0 ms 2023-02-11 19:03:51,258 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,258 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,258 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for 00d6e74697fa1ce107080ebe745c736f: Waiting for close lock at 1676142231256Disabling compacts and flushes for region at 1676142231256Disabling writes for close at 1676142231258 (+2 ms)Writing region close event to WAL at 1676142231258Closed at 1676142231258 2023-02-11 19:03:51,259 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,259 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,260 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,261 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:51,262 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1 2023-02-11 19:03:51,262 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08195ed3d944596f507693fab589a44d columnFamilyName f1 2023-02-11 19:03:51,266 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/testWithMockedMapReduceMultiRegion=08195ed3d944596f507693fab589a44d-7495ee15cfb24b8e9ebad9c393b621e4 2023-02-11 19:03:51,266 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(310): Store=08195ed3d944596f507693fab589a44d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,266 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:51,266 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2 2023-02-11 19:03:51,267 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08195ed3d944596f507693fab589a44d columnFamilyName f2 2023-02-11 19:03:51,270 DEBUG [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/testWithMockedMapReduceMultiRegion=08195ed3d944596f507693fab589a44d-25f3dfb64a764d4dae2a87aabecccec7 2023-02-11 19:03:51,270 INFO [StoreOpener-08195ed3d944596f507693fab589a44d-1] regionserver.HStore(310): Store=08195ed3d944596f507693fab589a44d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,270 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,270 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened 08195ed3d944596f507693fab589a44d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63455122, jitterRate=-0.05444499850273132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,271 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for 08195ed3d944596f507693fab589a44d: Writing region info on filesystem at 1676142231260Initializing all the Stores at 1676142231261 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231261Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231261Region opened successfully at 1676142231271 (+10 ms) 2023-02-11 19:03:51,281 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing 08195ed3d944596f507693fab589a44d, disabling compactions & flushes 2023-02-11 19:03:51,281 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,281 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,281 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. after waiting 0 ms 2023-02-11 19:03:51,281 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,282 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,282 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for 08195ed3d944596f507693fab589a44d: Waiting for close lock at 1676142231281Disabling compacts and flushes for region at 1676142231281Disabling writes for close at 1676142231281Writing region close event to WAL at 1676142231282 (+1 ms)Closed at 1676142231282 2023-02-11 19:03:51,282 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,282 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,284 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,285 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:51,286 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1 2023-02-11 19:03:51,286 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 250fd9e9a84209694813519eb2c15120 columnFamilyName f1 2023-02-11 19:03:51,290 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/testWithMockedMapReduceMultiRegion=250fd9e9a84209694813519eb2c15120-af699b641f9d47cba9ecb922d9b0a330 2023-02-11 19:03:51,290 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(310): Store=250fd9e9a84209694813519eb2c15120/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,290 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:51,290 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2 2023-02-11 19:03:51,291 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 250fd9e9a84209694813519eb2c15120 columnFamilyName f2 2023-02-11 19:03:51,294 DEBUG [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/testWithMockedMapReduceMultiRegion=250fd9e9a84209694813519eb2c15120-9301f9f35c424586b8e1915ff2cf750a 2023-02-11 19:03:51,295 INFO [StoreOpener-250fd9e9a84209694813519eb2c15120-1] regionserver.HStore(310): Store=250fd9e9a84209694813519eb2c15120/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,295 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,295 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened 250fd9e9a84209694813519eb2c15120; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73838594, jitterRate=0.10028079152107239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,295 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for 250fd9e9a84209694813519eb2c15120: Writing region info on filesystem at 1676142231284Initializing all the Stores at 1676142231284Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231284Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231284Region opened successfully at 1676142231295 (+11 ms) 2023-02-11 19:03:51,303 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing 250fd9e9a84209694813519eb2c15120, disabling compactions & flushes 2023-02-11 19:03:51,304 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,304 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,304 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. after waiting 0 ms 2023-02-11 19:03:51,304 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,305 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,305 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for 250fd9e9a84209694813519eb2c15120: Waiting for close lock at 1676142231303Disabling compacts and flushes for region at 1676142231303Disabling writes for close at 1676142231304 (+1 ms)Writing region close event to WAL at 1676142231305 (+1 ms)Closed at 1676142231305 2023-02-11 19:03:51,306 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,306 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,307 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,311 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:51,312 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1 2023-02-11 19:03:51,312 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c85ce637d478f3134eeab1bece5f1519 columnFamilyName f1 2023-02-11 19:03:51,316 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/testWithMockedMapReduceMultiRegion=c85ce637d478f3134eeab1bece5f1519-3eb1a38942ce48d18d9affd030c1343e 2023-02-11 19:03:51,316 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(310): Store=c85ce637d478f3134eeab1bece5f1519/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,316 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:51,317 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2 2023-02-11 19:03:51,317 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c85ce637d478f3134eeab1bece5f1519 columnFamilyName f2 2023-02-11 19:03:51,324 DEBUG [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/testWithMockedMapReduceMultiRegion=c85ce637d478f3134eeab1bece5f1519-1aa39970106a410a85a7ff81e3fcefd9 2023-02-11 19:03:51,324 INFO [StoreOpener-c85ce637d478f3134eeab1bece5f1519-1] regionserver.HStore(310): Store=c85ce637d478f3134eeab1bece5f1519/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,324 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,325 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened c85ce637d478f3134eeab1bece5f1519; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58938174, jitterRate=-0.1217527687549591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,325 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for c85ce637d478f3134eeab1bece5f1519: Writing region info on filesystem at 1676142231307Initializing all the Stores at 1676142231308 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231308Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231310 (+2 ms)Region opened successfully at 1676142231325 (+15 ms) 2023-02-11 19:03:51,336 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing c85ce637d478f3134eeab1bece5f1519, disabling compactions & flushes 2023-02-11 19:03:51,336 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,336 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,336 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. after waiting 0 ms 2023-02-11 19:03:51,337 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,337 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,337 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for c85ce637d478f3134eeab1bece5f1519: Waiting for close lock at 1676142231336Disabling compacts and flushes for region at 1676142231336Disabling writes for close at 1676142231337 (+1 ms)Writing region close event to WAL at 1676142231337Closed at 1676142231337 2023-02-11 19:03:51,338 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,338 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,339 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,341 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:51,342 DEBUG [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f1 2023-02-11 19:03:51,342 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f3ec0d707d000241353c40c0e15f85 columnFamilyName f1 2023-02-11 19:03:51,343 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(310): Store=f1f3ec0d707d000241353c40c0e15f85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,343 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:51,344 DEBUG [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f2 2023-02-11 19:03:51,344 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f3ec0d707d000241353c40c0e15f85 columnFamilyName f2 2023-02-11 19:03:51,344 INFO [StoreOpener-f1f3ec0d707d000241353c40c0e15f85-1] regionserver.HStore(310): Store=f1f3ec0d707d000241353c40c0e15f85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,344 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,344 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened f1f3ec0d707d000241353c40c0e15f85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60733824, jitterRate=-0.09499549865722656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,344 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for f1f3ec0d707d000241353c40c0e15f85: Writing region info on filesystem at 1676142231340Initializing all the Stores at 1676142231340Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231340Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231340Region opened successfully at 1676142231344 (+4 ms) 2023-02-11 19:03:51,345 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing f1f3ec0d707d000241353c40c0e15f85, disabling compactions & flushes 2023-02-11 19:03:51,345 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,345 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,345 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. after waiting 0 ms 2023-02-11 19:03:51,345 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,345 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,345 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for f1f3ec0d707d000241353c40c0e15f85: Waiting for close lock at 1676142231345Disabling compacts and flushes for region at 1676142231345Disabling writes for close at 1676142231345Writing region close event to WAL at 1676142231345Closed at 1676142231345 2023-02-11 19:03:51,346 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,346 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,347 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,348 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:51,349 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1 2023-02-11 19:03:51,349 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38416af4cd6d58c860a4d3a6b4583041 columnFamilyName f1 2023-02-11 19:03:51,353 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/testWithMockedMapReduceMultiRegion=38416af4cd6d58c860a4d3a6b4583041-30ca42a9be2745309b93c1524c74ab42 2023-02-11 19:03:51,353 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(310): Store=38416af4cd6d58c860a4d3a6b4583041/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,353 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:51,354 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2 2023-02-11 19:03:51,354 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38416af4cd6d58c860a4d3a6b4583041 columnFamilyName f2 2023-02-11 19:03:51,357 DEBUG [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/testWithMockedMapReduceMultiRegion=38416af4cd6d58c860a4d3a6b4583041-c90af635102b49f481825919979378b8 2023-02-11 19:03:51,357 INFO [StoreOpener-38416af4cd6d58c860a4d3a6b4583041-1] regionserver.HStore(310): Store=38416af4cd6d58c860a4d3a6b4583041/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,357 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,358 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened 38416af4cd6d58c860a4d3a6b4583041; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71886599, jitterRate=0.07119379937648773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,358 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for 38416af4cd6d58c860a4d3a6b4583041: Writing region info on filesystem at 1676142231347Initializing all the Stores at 1676142231347Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231347Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231347Region opened successfully at 1676142231358 (+11 ms) 2023-02-11 19:03:51,367 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing 38416af4cd6d58c860a4d3a6b4583041, disabling compactions & flushes 2023-02-11 19:03:51,367 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,367 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,367 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. after waiting 0 ms 2023-02-11 19:03:51,367 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,368 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,368 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for 38416af4cd6d58c860a4d3a6b4583041: Waiting for close lock at 1676142231367Disabling compacts and flushes for region at 1676142231367Disabling writes for close at 1676142231367Writing region close event to WAL at 1676142231368 (+1 ms)Closed at 1676142231368 2023-02-11 19:03:51,369 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,369 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,370 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,371 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:51,373 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1 2023-02-11 19:03:51,373 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab3d861e282353c06e89875e8c583f4b columnFamilyName f1 2023-02-11 19:03:51,377 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/testWithMockedMapReduceMultiRegion=ab3d861e282353c06e89875e8c583f4b-f874e1958780475988eaf4c7f6ddaac1 2023-02-11 19:03:51,377 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(310): Store=ab3d861e282353c06e89875e8c583f4b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,377 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:51,377 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2 2023-02-11 19:03:51,378 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab3d861e282353c06e89875e8c583f4b columnFamilyName f2 2023-02-11 19:03:51,381 DEBUG [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/testWithMockedMapReduceMultiRegion=ab3d861e282353c06e89875e8c583f4b-56b9d9fae9f94c0889b603f4891f638d 2023-02-11 19:03:51,381 INFO [StoreOpener-ab3d861e282353c06e89875e8c583f4b-1] regionserver.HStore(310): Store=ab3d861e282353c06e89875e8c583f4b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,381 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,381 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened ab3d861e282353c06e89875e8c583f4b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61350974, jitterRate=-0.08579924702644348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,381 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for ab3d861e282353c06e89875e8c583f4b: Writing region info on filesystem at 1676142231370Initializing all the Stores at 1676142231370Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231371 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231371Region opened successfully at 1676142231381 (+10 ms) 2023-02-11 19:03:51,390 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing ab3d861e282353c06e89875e8c583f4b, disabling compactions & flushes 2023-02-11 19:03:51,390 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,390 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,390 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. after waiting 0 ms 2023-02-11 19:03:51,390 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,391 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,391 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for ab3d861e282353c06e89875e8c583f4b: Waiting for close lock at 1676142231390Disabling compacts and flushes for region at 1676142231390Disabling writes for close at 1676142231390Writing region close event to WAL at 1676142231391 (+1 ms)Closed at 1676142231391 2023-02-11 19:03:51,392 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,392 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,397 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,398 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:51,399 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1 2023-02-11 19:03:51,399 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acf9c9b53025adcced4cf9882c5cf898 columnFamilyName f1 2023-02-11 19:03:51,403 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/testWithMockedMapReduceMultiRegion=acf9c9b53025adcced4cf9882c5cf898-a96cf28bf84347debc8d66e84cdde5d9 2023-02-11 19:03:51,403 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(310): Store=acf9c9b53025adcced4cf9882c5cf898/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,403 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:51,404 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2 2023-02-11 19:03:51,404 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acf9c9b53025adcced4cf9882c5cf898 columnFamilyName f2 2023-02-11 19:03:51,408 DEBUG [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/testWithMockedMapReduceMultiRegion=acf9c9b53025adcced4cf9882c5cf898-4a1061cd9b5c45a09e65970439f033ab 2023-02-11 19:03:51,408 INFO [StoreOpener-acf9c9b53025adcced4cf9882c5cf898-1] regionserver.HStore(310): Store=acf9c9b53025adcced4cf9882c5cf898/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,408 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,408 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened acf9c9b53025adcced4cf9882c5cf898; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60518373, jitterRate=-0.09820596873760223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,408 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for acf9c9b53025adcced4cf9882c5cf898: Writing region info on filesystem at 1676142231397Initializing all the Stores at 1676142231397Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231398 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231398Region opened successfully at 1676142231408 (+10 ms) 2023-02-11 19:03:51,416 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing acf9c9b53025adcced4cf9882c5cf898, disabling compactions & flushes 2023-02-11 19:03:51,416 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,416 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,416 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. after waiting 0 ms 2023-02-11 19:03:51,416 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,417 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,417 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for acf9c9b53025adcced4cf9882c5cf898: Waiting for close lock at 1676142231416Disabling compacts and flushes for region at 1676142231416Disabling writes for close at 1676142231416Writing region close event to WAL at 1676142231417 (+1 ms)Closed at 1676142231417 2023-02-11 19:03:51,417 DEBUG [Listener at localhost/36327] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:51,417 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:51,419 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:51,420 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:51,421 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1 2023-02-11 19:03:51,421 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f707008aad36f10c42eb3e971cd2975 columnFamilyName f1 2023-02-11 19:03:51,425 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/testWithMockedMapReduceMultiRegion=9f707008aad36f10c42eb3e971cd2975-89d234b0059d4dc8a53304acc6c60276 2023-02-11 19:03:51,425 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(310): Store=9f707008aad36f10c42eb3e971cd2975/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,425 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:51,426 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2 2023-02-11 19:03:51,426 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f707008aad36f10c42eb3e971cd2975 columnFamilyName f2 2023-02-11 19:03:51,429 DEBUG [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(539): loaded hdfs://localhost:32807/user/jenkins/test-data/1b3eea0a-528f-80d7-2264-1d6237a7d4c2/testWithMockedMapReduceMultiRegion/73e58bc4-4f58-49c7-99a5-60fe9b9922d9/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/testWithMockedMapReduceMultiRegion=9f707008aad36f10c42eb3e971cd2975-8e350fad6dd94fc4990937ecc1cf794c 2023-02-11 19:03:51,429 INFO [StoreOpener-9f707008aad36f10c42eb3e971cd2975-1] regionserver.HStore(310): Store=9f707008aad36f10c42eb3e971cd2975/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:51,430 DEBUG [Listener at localhost/36327] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:51,430 INFO [Listener at localhost/36327] regionserver.HRegion(1071): Opened 9f707008aad36f10c42eb3e971cd2975; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65938662, jitterRate=-0.017437368631362915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:51,430 DEBUG [Listener at localhost/36327] regionserver.HRegion(964): Region open journal for 9f707008aad36f10c42eb3e971cd2975: Writing region info on filesystem at 1676142231419Initializing all the Stores at 1676142231419Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231419Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142231419Region opened successfully at 1676142231430 (+11 ms) 2023-02-11 19:03:51,438 DEBUG [Listener at localhost/36327] regionserver.HRegion(1603): Closing 9f707008aad36f10c42eb3e971cd2975, disabling compactions & flushes 2023-02-11 19:03:51,438 INFO [Listener at localhost/36327] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,438 DEBUG [Listener at localhost/36327] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,438 DEBUG [Listener at localhost/36327] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. after waiting 0 ms 2023-02-11 19:03:51,438 DEBUG [Listener at localhost/36327] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,439 INFO [Listener at localhost/36327] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,439 DEBUG [Listener at localhost/36327] regionserver.HRegion(1557): Region close journal for 9f707008aad36f10c42eb3e971cd2975: Waiting for close lock at 1676142231438Disabling compacts and flushes for region at 1676142231438Disabling writes for close at 1676142231438Writing region close event to WAL at 1676142231439 (+1 ms)Closed at 1676142231439 2023-02-11 19:03:51,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-11 19:03:51,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-11 19:03:51,446 INFO [Listener at localhost/36327] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-11 19:03:51,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-11 19:03:51,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:51,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:51,450 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142231450"}]},"ts":"1676142231450"} 2023-02-11 19:03:51,451 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-11 19:03:51,533 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-11 19:03:51,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, UNASSIGN}] 2023-02-11 19:03:51,537 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, UNASSIGN 2023-02-11 19:03:51,537 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, UNASSIGN 2023-02-11 19:03:51,537 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, UNASSIGN 2023-02-11 19:03:51,537 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, UNASSIGN 2023-02-11 19:03:51,537 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, UNASSIGN 2023-02-11 19:03:51,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=acf9c9b53025adcced4cf9882c5cf898, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:51,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=f1f3ec0d707d000241353c40c0e15f85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:51,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231538"}]},"ts":"1676142231538"} 2023-02-11 19:03:51,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ab3d861e282353c06e89875e8c583f4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:51,538 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231538"}]},"ts":"1676142231538"} 2023-02-11 19:03:51,538 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=38416af4cd6d58c860a4d3a6b4583041, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:51,538 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=017c1ac7e61aee05e086a4f402774949, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:51,538 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231538"}]},"ts":"1676142231538"} 2023-02-11 19:03:51,538 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142231538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231538"}]},"ts":"1676142231538"} 2023-02-11 19:03:51,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142231538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231538"}]},"ts":"1676142231538"} 2023-02-11 19:03:51,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure acf9c9b53025adcced4cf9882c5cf898, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:51,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure ab3d861e282353c06e89875e8c583f4b, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:51,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=35, state=RUNNABLE; CloseRegionProcedure 38416af4cd6d58c860a4d3a6b4583041, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:51,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 017c1ac7e61aee05e086a4f402774949, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:51,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure f1f3ec0d707d000241353c40c0e15f85, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:51,547 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, UNASSIGN 2023-02-11 19:03:51,547 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, UNASSIGN 2023-02-11 19:03:51,547 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, UNASSIGN 2023-02-11 19:03:51,547 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, UNASSIGN 2023-02-11 19:03:51,547 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, UNASSIGN 2023-02-11 19:03:51,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=250fd9e9a84209694813519eb2c15120, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:51,547 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=08195ed3d944596f507693fab589a44d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:51,548 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231547"}]},"ts":"1676142231547"} 2023-02-11 19:03:51,548 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9f707008aad36f10c42eb3e971cd2975, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:51,548 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231547"}]},"ts":"1676142231547"} 2023-02-11 19:03:51,548 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231548"}]},"ts":"1676142231548"} 2023-02-11 19:03:51,548 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=00d6e74697fa1ce107080ebe745c736f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:51,548 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c85ce637d478f3134eeab1bece5f1519, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:51,548 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231548"}]},"ts":"1676142231548"} 2023-02-11 19:03:51,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142231548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142231548"}]},"ts":"1676142231548"} 2023-02-11 19:03:51,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=41, state=RUNNABLE; CloseRegionProcedure 250fd9e9a84209694813519eb2c15120, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:51,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=42, state=RUNNABLE; CloseRegionProcedure 08195ed3d944596f507693fab589a44d, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:51,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 9f707008aad36f10c42eb3e971cd2975, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:51,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:51,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 00d6e74697fa1ce107080ebe745c736f, server=jenkins-hbase4.apache.org,36693,1676142225955}] 2023-02-11 19:03:51,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure c85ce637d478f3134eeab1bece5f1519, server=jenkins-hbase4.apache.org,39279,1676142225989}] 2023-02-11 19:03:51,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:51,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:51,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f1f3ec0d707d000241353c40c0e15f85, disabling compactions & flushes 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 38416af4cd6d58c860a4d3a6b4583041, disabling compactions & flushes 2023-02-11 19:03:51,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. after waiting 0 ms 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. after waiting 0 ms 2023-02-11 19:03:51,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:03:51,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041. 2023-02-11 19:03:51,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 38416af4cd6d58c860a4d3a6b4583041: Waiting for close lock at 1676142231696Running coprocessor pre-close hooks at 1676142231697 (+1 ms)Disabling compacts and flushes for region at 1676142231697Disabling writes for close at 1676142231697Writing region close event to WAL at 1676142231698 (+1 ms)Running coprocessor post-close hooks at 1676142231701 (+3 ms)Closed at 1676142231701 2023-02-11 19:03:51,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85. 2023-02-11 19:03:51,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f1f3ec0d707d000241353c40c0e15f85: Waiting for close lock at 1676142231696Running coprocessor pre-close hooks at 1676142231696Disabling compacts and flushes for region at 1676142231696Disabling writes for close at 1676142231697 (+1 ms)Writing region close event to WAL at 1676142231697Running coprocessor post-close hooks at 1676142231701 (+4 ms)Closed at 1676142231701 2023-02-11 19:03:51,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:51,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:51,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9f707008aad36f10c42eb3e971cd2975, disabling compactions & flushes 2023-02-11 19:03:51,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. after waiting 0 ms 2023-02-11 19:03:51,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=38416af4cd6d58c860a4d3a6b4583041, regionState=CLOSED 2023-02-11 19:03:51,703 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231702"}]},"ts":"1676142231702"} 2023-02-11 19:03:51,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:51,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:51,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 017c1ac7e61aee05e086a4f402774949, disabling compactions & flushes 2023-02-11 19:03:51,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. after waiting 0 ms 2023-02-11 19:03:51,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,703 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=f1f3ec0d707d000241353c40c0e15f85, regionState=CLOSED 2023-02-11 19:03:51,703 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142231703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231703"}]},"ts":"1676142231703"} 2023-02-11 19:03:51,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=35 2023-02-11 19:03:51,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=35, state=SUCCESS; CloseRegionProcedure 38416af4cd6d58c860a4d3a6b4583041, server=jenkins-hbase4.apache.org,39279,1676142225989 in 164 msec 2023-02-11 19:03:51,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-11 19:03:51,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure f1f3ec0d707d000241353c40c0e15f85, server=jenkins-hbase4.apache.org,36693,1676142225955 in 164 msec 2023-02-11 19:03:51,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38416af4cd6d58c860a4d3a6b4583041, UNASSIGN in 173 msec 2023-02-11 19:03:51,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f1f3ec0d707d000241353c40c0e15f85, UNASSIGN in 173 msec 2023-02-11 19:03:51,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 19:03:51,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975. 2023-02-11 19:03:51,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9f707008aad36f10c42eb3e971cd2975: Waiting for close lock at 1676142231702Running coprocessor pre-close hooks at 1676142231702Disabling compacts and flushes for region at 1676142231702Disabling writes for close at 1676142231702Writing region close event to WAL at 1676142231704 (+2 ms)Running coprocessor post-close hooks at 1676142231712 (+8 ms)Closed at 1676142231712 2023-02-11 19:03:51,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949. 2023-02-11 19:03:51,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 017c1ac7e61aee05e086a4f402774949: Waiting for close lock at 1676142231703Running coprocessor pre-close hooks at 1676142231703Disabling compacts and flushes for region at 1676142231703Disabling writes for close at 1676142231703Writing region close event to WAL at 1676142231703Running coprocessor post-close hooks at 1676142231712 (+9 ms)Closed at 1676142231712 2023-02-11 19:03:51,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:51,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:51,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c85ce637d478f3134eeab1bece5f1519, disabling compactions & flushes 2023-02-11 19:03:51,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. after waiting 0 ms 2023-02-11 19:03:51,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,713 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9f707008aad36f10c42eb3e971cd2975, regionState=CLOSED 2023-02-11 19:03:51,713 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231713"}]},"ts":"1676142231713"} 2023-02-11 19:03:51,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:51,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:51,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 250fd9e9a84209694813519eb2c15120, disabling compactions & flushes 2023-02-11 19:03:51,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. after waiting 0 ms 2023-02-11 19:03:51,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,714 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=017c1ac7e61aee05e086a4f402774949, regionState=CLOSED 2023-02-11 19:03:51,714 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676142231714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231714"}]},"ts":"1676142231714"} 2023-02-11 19:03:51,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-11 19:03:51,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 9f707008aad36f10c42eb3e971cd2975, server=jenkins-hbase4.apache.org,39279,1676142225989 in 164 msec 2023-02-11 19:03:51,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9f707008aad36f10c42eb3e971cd2975, UNASSIGN in 182 msec 2023-02-11 19:03:51,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-11 19:03:51,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 017c1ac7e61aee05e086a4f402774949, server=jenkins-hbase4.apache.org,36693,1676142225955 in 175 msec 2023-02-11 19:03:51,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519. 2023-02-11 19:03:51,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=017c1ac7e61aee05e086a4f402774949, UNASSIGN in 185 msec 2023-02-11 19:03:51,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c85ce637d478f3134eeab1bece5f1519: Waiting for close lock at 1676142231713Running coprocessor pre-close hooks at 1676142231713Disabling compacts and flushes for region at 1676142231713Disabling writes for close at 1676142231713Writing region close event to WAL at 1676142231715 (+2 ms)Running coprocessor post-close hooks at 1676142231720 (+5 ms)Closed at 1676142231720 2023-02-11 19:03:51,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:51,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120. 2023-02-11 19:03:51,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:51,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 250fd9e9a84209694813519eb2c15120: Waiting for close lock at 1676142231714Running coprocessor pre-close hooks at 1676142231714Disabling compacts and flushes for region at 1676142231714Disabling writes for close at 1676142231714Writing region close event to WAL at 1676142231715 (+1 ms)Running coprocessor post-close hooks at 1676142231721 (+6 ms)Closed at 1676142231721 2023-02-11 19:03:51,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08195ed3d944596f507693fab589a44d, disabling compactions & flushes 2023-02-11 19:03:51,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. after waiting 0 ms 2023-02-11 19:03:51,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,722 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c85ce637d478f3134eeab1bece5f1519, regionState=CLOSED 2023-02-11 19:03:51,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231722"}]},"ts":"1676142231722"} 2023-02-11 19:03:51,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:51,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:51,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 00d6e74697fa1ce107080ebe745c736f, disabling compactions & flushes 2023-02-11 19:03:51,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. after waiting 0 ms 2023-02-11 19:03:51,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,725 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=250fd9e9a84209694813519eb2c15120, regionState=CLOSED 2023-02-11 19:03:51,725 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231725"}]},"ts":"1676142231725"} 2023-02-11 19:03:51,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-11 19:03:51,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure c85ce637d478f3134eeab1bece5f1519, server=jenkins-hbase4.apache.org,39279,1676142225989 in 168 msec 2023-02-11 19:03:51,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c85ce637d478f3134eeab1bece5f1519, UNASSIGN in 192 msec 2023-02-11 19:03:51,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=41 2023-02-11 19:03:51,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=41, state=SUCCESS; CloseRegionProcedure 250fd9e9a84209694813519eb2c15120, server=jenkins-hbase4.apache.org,36693,1676142225955 in 177 msec 2023-02-11 19:03:51,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=250fd9e9a84209694813519eb2c15120, UNASSIGN in 193 msec 2023-02-11 19:03:51,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d. 2023-02-11 19:03:51,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08195ed3d944596f507693fab589a44d: Waiting for close lock at 1676142231722Running coprocessor pre-close hooks at 1676142231722Disabling compacts and flushes for region at 1676142231722Disabling writes for close at 1676142231722Writing region close event to WAL at 1676142231728 (+6 ms)Running coprocessor post-close hooks at 1676142231732 (+4 ms)Closed at 1676142231732 2023-02-11 19:03:51,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 08195ed3d944596f507693fab589a44d 2023-02-11 19:03:51,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:51,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing acf9c9b53025adcced4cf9882c5cf898, disabling compactions & flushes 2023-02-11 19:03:51,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. after waiting 0 ms 2023-02-11 19:03:51,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f. 2023-02-11 19:03:51,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 00d6e74697fa1ce107080ebe745c736f: Waiting for close lock at 1676142231724Running coprocessor pre-close hooks at 1676142231724Disabling compacts and flushes for region at 1676142231724Disabling writes for close at 1676142231725 (+1 ms)Writing region close event to WAL at 1676142231729 (+4 ms)Running coprocessor post-close hooks at 1676142231734 (+5 ms)Closed at 1676142231734 2023-02-11 19:03:51,734 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=08195ed3d944596f507693fab589a44d, regionState=CLOSED 2023-02-11 19:03:51,734 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231734"}]},"ts":"1676142231734"} 2023-02-11 19:03:51,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:51,736 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=00d6e74697fa1ce107080ebe745c736f, regionState=CLOSED 2023-02-11 19:03:51,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:51,736 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231736"}]},"ts":"1676142231736"} 2023-02-11 19:03:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ab3d861e282353c06e89875e8c583f4b, disabling compactions & flushes 2023-02-11 19:03:51,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. after waiting 0 ms 2023-02-11 19:03:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=42 2023-02-11 19:03:51,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=42, state=SUCCESS; CloseRegionProcedure 08195ed3d944596f507693fab589a44d, server=jenkins-hbase4.apache.org,39279,1676142225989 in 186 msec 2023-02-11 19:03:51,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-11 19:03:51,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 00d6e74697fa1ce107080ebe745c736f, server=jenkins-hbase4.apache.org,36693,1676142225955 in 185 msec 2023-02-11 19:03:51,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08195ed3d944596f507693fab589a44d, UNASSIGN in 204 msec 2023-02-11 19:03:51,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898. 2023-02-11 19:03:51,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for acf9c9b53025adcced4cf9882c5cf898: Waiting for close lock at 1676142231734Running coprocessor pre-close hooks at 1676142231734Disabling compacts and flushes for region at 1676142231734Disabling writes for close at 1676142231734Writing region close event to WAL at 1676142231736 (+2 ms)Running coprocessor post-close hooks at 1676142231741 (+5 ms)Closed at 1676142231741 2023-02-11 19:03:51,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00d6e74697fa1ce107080ebe745c736f, UNASSIGN in 205 msec 2023-02-11 19:03:51,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:51,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b. 2023-02-11 19:03:51,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ab3d861e282353c06e89875e8c583f4b: Waiting for close lock at 1676142231736Running coprocessor pre-close hooks at 1676142231736Disabling compacts and flushes for region at 1676142231736Disabling writes for close at 1676142231736Writing region close event to WAL at 1676142231738 (+2 ms)Running coprocessor post-close hooks at 1676142231742 (+4 ms)Closed at 1676142231742 2023-02-11 19:03:51,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:51,745 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ab3d861e282353c06e89875e8c583f4b, regionState=CLOSED 2023-02-11 19:03:51,745 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231745"}]},"ts":"1676142231745"} 2023-02-11 19:03:51,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:51,746 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=acf9c9b53025adcced4cf9882c5cf898, regionState=CLOSED 2023-02-11 19:03:51,746 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676142231746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142231746"}]},"ts":"1676142231746"} 2023-02-11 19:03:51,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-11 19:03:51,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure ab3d861e282353c06e89875e8c583f4b, server=jenkins-hbase4.apache.org,36693,1676142225955 in 206 msec 2023-02-11 19:03:51,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-11 19:03:51,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure acf9c9b53025adcced4cf9882c5cf898, server=jenkins-hbase4.apache.org,39279,1676142225989 in 207 msec 2023-02-11 19:03:51,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ab3d861e282353c06e89875e8c583f4b, UNASSIGN in 214 msec 2023-02-11 19:03:51,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-11 19:03:51,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=acf9c9b53025adcced4cf9882c5cf898, UNASSIGN in 214 msec 2023-02-11 19:03:51,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:51,754 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142231754"}]},"ts":"1676142231754"} 2023-02-11 19:03:51,755 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-11 19:03:51,757 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-11 19:03:51,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 312 msec 2023-02-11 19:03:52,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 19:03:52,056 INFO [Listener at localhost/36327] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-11 19:03:52,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,059 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,060 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 19:03:52,070 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:52,070 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:52,071 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:52,071 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:52,070 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:52,070 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:52,070 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:52,070 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:52,074 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/recovered.edits] 2023-02-11 19:03:52,074 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/recovered.edits] 2023-02-11 19:03:52,074 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/recovered.edits] 2023-02-11 19:03:52,075 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/recovered.edits] 2023-02-11 19:03:52,075 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/recovered.edits] 2023-02-11 19:03:52,075 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/recovered.edits] 2023-02-11 19:03:52,075 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/recovered.edits] 2023-02-11 19:03:52,076 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/recovered.edits] 2023-02-11 19:03:52,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/08f70570b26444eba345a174a28e7679 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/08f70570b26444eba345a174a28e7679 2023-02-11 19:03:52,085 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/03995be421af49fe8212f0beb97a464d to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/03995be421af49fe8212f0beb97a464d 2023-02-11 19:03:52,085 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/5a1b8e8eef524e3eb8dbd7881cf5dacd 2023-02-11 19:03:52,086 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/03385efb0b3344db91f27205ca96ded7 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/03385efb0b3344db91f27205ca96ded7 2023-02-11 19:03:52,086 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/63f2d0be2b2b4838908a923116e607aa to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/63f2d0be2b2b4838908a923116e607aa 2023-02-11 19:03:52,087 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/715b44d871f84b90988cbd1142612ac2 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/715b44d871f84b90988cbd1142612ac2 2023-02-11 19:03:52,087 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/d7fe0fa07af540ab9e445d1a2379d914 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/d7fe0fa07af540ab9e445d1a2379d914 2023-02-11 19:03:52,088 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/af699b641f9d47cba9ecb922d9b0a330 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f1/af699b641f9d47cba9ecb922d9b0a330 2023-02-11 19:03:52,089 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/30ca42a9be2745309b93c1524c74ab42 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f1/30ca42a9be2745309b93c1524c74ab42 2023-02-11 19:03:52,089 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/7e24b53c9021423e84e99f3630359382 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f1/7e24b53c9021423e84e99f3630359382 2023-02-11 19:03:52,090 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/a96cf28bf84347debc8d66e84cdde5d9 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f1/a96cf28bf84347debc8d66e84cdde5d9 2023-02-11 19:03:52,090 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/f874e1958780475988eaf4c7f6ddaac1 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f1/f874e1958780475988eaf4c7f6ddaac1 2023-02-11 19:03:52,090 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/3eb1a38942ce48d18d9affd030c1343e to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f1/3eb1a38942ce48d18d9affd030c1343e 2023-02-11 19:03:52,091 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/89d234b0059d4dc8a53304acc6c60276 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f1/89d234b0059d4dc8a53304acc6c60276 2023-02-11 19:03:52,093 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/recovered.edits/6.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85/recovered.edits/6.seqid 2023-02-11 19:03:52,094 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/748a6ae48bb847a1baccfddfe29d8700 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/748a6ae48bb847a1baccfddfe29d8700 2023-02-11 19:03:52,094 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/f1f3ec0d707d000241353c40c0e15f85 2023-02-11 19:03:52,094 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d 2023-02-11 19:03:52,096 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/4adfb712d69a491c9dc64f0cc6fbccaf to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/4adfb712d69a491c9dc64f0cc6fbccaf 2023-02-11 19:03:52,097 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/4a1061cd9b5c45a09e65970439f033ab to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/4a1061cd9b5c45a09e65970439f033ab 2023-02-11 19:03:52,097 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/9301f9f35c424586b8e1915ff2cf750a to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/f2/9301f9f35c424586b8e1915ff2cf750a 2023-02-11 19:03:52,097 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/254aa078217a412b9a9d53c125d02f09 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/254aa078217a412b9a9d53c125d02f09 2023-02-11 19:03:52,098 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/1aa39970106a410a85a7ff81e3fcefd9 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/1aa39970106a410a85a7ff81e3fcefd9 2023-02-11 19:03:52,099 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/b14f74010919425196266ea4ce923696 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/b14f74010919425196266ea4ce923696 2023-02-11 19:03:52,099 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/recovered.edits] 2023-02-11 19:03:52,099 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/8e350fad6dd94fc4990937ecc1cf794c to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/8e350fad6dd94fc4990937ecc1cf794c 2023-02-11 19:03:52,100 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/6384b59d261741cdb743886c004b936a to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/f2/6384b59d261741cdb743886c004b936a 2023-02-11 19:03:52,100 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/610c872fcfc54b5e9ec0d51153dc4b4a to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/f2/610c872fcfc54b5e9ec0d51153dc4b4a 2023-02-11 19:03:52,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/56b9d9fae9f94c0889b603f4891f638d to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/f2/56b9d9fae9f94c0889b603f4891f638d 2023-02-11 19:03:52,101 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/46eb75e604fd425aaa16c7c65db8fd59 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/f2/46eb75e604fd425aaa16c7c65db8fd59 2023-02-11 19:03:52,102 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/c90af635102b49f481825919979378b8 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/f2/c90af635102b49f481825919979378b8 2023-02-11 19:03:52,102 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120/recovered.edits/12.seqid 2023-02-11 19:03:52,102 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/e040c4d0d569490eaa8597a7c0c8289f to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/f2/e040c4d0d569490eaa8597a7c0c8289f 2023-02-11 19:03:52,103 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/250fd9e9a84209694813519eb2c15120 2023-02-11 19:03:52,103 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:52,105 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f/recovered.edits/12.seqid 2023-02-11 19:03:52,106 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/00d6e74697fa1ce107080ebe745c736f 2023-02-11 19:03:52,107 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898/recovered.edits/12.seqid 2023-02-11 19:03:52,107 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b/recovered.edits/12.seqid 2023-02-11 19:03:52,107 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041/recovered.edits/12.seqid 2023-02-11 19:03:52,107 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/3c12b89645084f99b3c38344ec64eaa7 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/3c12b89645084f99b3c38344ec64eaa7 2023-02-11 19:03:52,107 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/recovered.edits] 2023-02-11 19:03:52,107 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975/recovered.edits/12.seqid 2023-02-11 19:03:52,108 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/acf9c9b53025adcced4cf9882c5cf898 2023-02-11 19:03:52,108 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/ab3d861e282353c06e89875e8c583f4b 2023-02-11 19:03:52,108 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519/recovered.edits/12.seqid 2023-02-11 19:03:52,108 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/38416af4cd6d58c860a4d3a6b4583041 2023-02-11 19:03:52,108 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/9f707008aad36f10c42eb3e971cd2975 2023-02-11 19:03:52,109 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/c85ce637d478f3134eeab1bece5f1519 2023-02-11 19:03:52,109 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/7495ee15cfb24b8e9ebad9c393b621e4 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f1/7495ee15cfb24b8e9ebad9c393b621e4 2023-02-11 19:03:52,112 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/085c7afc61c1453ca28c578b3b0edaa5 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/085c7afc61c1453ca28c578b3b0edaa5 2023-02-11 19:03:52,113 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/recovered.edits/6.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949/recovered.edits/6.seqid 2023-02-11 19:03:52,114 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/25f3dfb64a764d4dae2a87aabecccec7 to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/f2/25f3dfb64a764d4dae2a87aabecccec7 2023-02-11 19:03:52,114 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/017c1ac7e61aee05e086a4f402774949 2023-02-11 19:03:52,116 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/archive/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d/recovered.edits/12.seqid 2023-02-11 19:03:52,116 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/.tmp/data/default/testWithMockedMapReduceMultiRegion/08195ed3d944596f507693fab589a44d 2023-02-11 19:03:52,117 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-11 19:03:52,119 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,122 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-11 19:03:52,124 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142232125"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,140 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-11 19:03:52,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f1f3ec0d707d000241353c40c0e15f85, NAME => 'testWithMockedMapReduceMultiRegion,,1676142227528.f1f3ec0d707d000241353c40c0e15f85.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 38416af4cd6d58c860a4d3a6b4583041, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676142227528.38416af4cd6d58c860a4d3a6b4583041.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => acf9c9b53025adcced4cf9882c5cf898, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676142227528.acf9c9b53025adcced4cf9882c5cf898.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => ab3d861e282353c06e89875e8c583f4b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676142227528.ab3d861e282353c06e89875e8c583f4b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => c85ce637d478f3134eeab1bece5f1519, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676142227528.c85ce637d478f3134eeab1bece5f1519.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 00d6e74697fa1ce107080ebe745c736f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676142227528.00d6e74697fa1ce107080ebe745c736f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9f707008aad36f10c42eb3e971cd2975, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676142227528.9f707008aad36f10c42eb3e971cd2975.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 250fd9e9a84209694813519eb2c15120, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676142227528.250fd9e9a84209694813519eb2c15120.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 08195ed3d944596f507693fab589a44d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676142227528.08195ed3d944596f507693fab589a44d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 017c1ac7e61aee05e086a4f402774949, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676142227528.017c1ac7e61aee05e086a4f402774949.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-11 19:03:52,140 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-11 19:03:52,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676142232140"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:52,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 19:03:52,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-11 19:03:52,168 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 19:03:52,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 111 msec 2023-02-11 19:03:52,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40255] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 19:03:52,364 INFO [Listener at localhost/36327] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-11 19:03:52,364 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:03:52,364 INFO [Listener at localhost/36327] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:03:52,364 DEBUG [Listener at localhost/36327] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73e84268 to 127.0.0.1:59226 2023-02-11 19:03:52,365 DEBUG [Listener at localhost/36327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,365 DEBUG [Listener at localhost/36327] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:03:52,365 DEBUG [Listener at localhost/36327] util.JVMClusterUtil(257): Found active master hash=118482115, stopped=false 2023-02-11 19:03:52,365 INFO [Listener at localhost/36327] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:52,368 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:52,368 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:52,368 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:52,368 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:52,368 INFO [Listener at localhost/36327] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:03:52,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:52,371 DEBUG [Listener at localhost/36327] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d00613f to 127.0.0.1:59226 2023-02-11 19:03:52,371 DEBUG [Listener at localhost/36327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:52,371 INFO [Listener at localhost/36327] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36693,1676142225955' ***** 2023-02-11 19:03:52,371 INFO [Listener at localhost/36327] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:52,372 INFO [Listener at localhost/36327] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39279,1676142225989' ***** 2023-02-11 19:03:52,372 INFO [Listener at localhost/36327] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:52,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:52,372 INFO [RS:1;jenkins-hbase4:39279] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:52,372 INFO [RS:1;jenkins-hbase4:39279] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:52,372 INFO [RS:1;jenkins-hbase4:39279] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:52,372 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:52,372 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(3304): Received CLOSE for 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:52,373 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:52,373 DEBUG [RS:1;jenkins-hbase4:39279] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a547229 to 127.0.0.1:59226 2023-02-11 19:03:52,373 INFO [RS:0;jenkins-hbase4:36693] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:52,374 DEBUG [RS:1;jenkins-hbase4:39279] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,374 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:52,374 INFO [RS:1;jenkins-hbase4:39279] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:52,375 INFO [RS:1;jenkins-hbase4:39279] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:52,375 INFO [RS:1;jenkins-hbase4:39279] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:52,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3adc064ba8379502fd26b187dfac1c1f, disabling compactions & flushes 2023-02-11 19:03:52,375 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:03:52,374 INFO [RS:0;jenkins-hbase4:36693] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:52,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. after waiting 0 ms 2023-02-11 19:03:52,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:52,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3adc064ba8379502fd26b187dfac1c1f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:03:52,375 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 19:03:52,375 INFO [RS:0;jenkins-hbase4:36693] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:52,375 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:52,375 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1479): Online Regions={3adc064ba8379502fd26b187dfac1c1f=hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 19:03:52,378 DEBUG [RS:0;jenkins-hbase4:36693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40946e26 to 127.0.0.1:59226 2023-02-11 19:03:52,378 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1505): Waiting on 1588230740, 3adc064ba8379502fd26b187dfac1c1f 2023-02-11 19:03:52,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:52,378 DEBUG [RS:0;jenkins-hbase4:36693] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:52,378 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36693,1676142225955; all regions closed. 2023-02-11 19:03:52,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:52,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:52,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:52,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-11 19:03:52,384 DEBUG [RS:0;jenkins-hbase4:36693] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/oldWALs 2023-02-11 19:03:52,384 INFO [RS:0;jenkins-hbase4:36693] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36693%2C1676142225955:(num 1676142227290) 2023-02-11 19:03:52,384 DEBUG [RS:0;jenkins-hbase4:36693] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,384 INFO [RS:0;jenkins-hbase4:36693] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:52,384 INFO [RS:0;jenkins-hbase4:36693] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:52,385 INFO [RS:0;jenkins-hbase4:36693] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:52,385 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:52,385 INFO [RS:0;jenkins-hbase4:36693] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:52,385 INFO [RS:0;jenkins-hbase4:36693] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:52,386 INFO [RS:0;jenkins-hbase4:36693] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36693 2023-02-11 19:03:52,390 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:52,390 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:52,390 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36693,1676142225955 2023-02-11 19:03:52,390 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62278bbe rejected from java.util.concurrent.ThreadPoolExecutor@66180322[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:52,390 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:52,390 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c57df4c rejected from java.util.concurrent.ThreadPoolExecutor@66180322[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:52,391 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:52,397 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36693,1676142225955] 2023-02-11 19:03:52,397 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36693,1676142225955; numProcessing=1 2023-02-11 19:03:52,398 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36693,1676142225955 already deleted, retry=false 2023-02-11 19:03:52,398 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36693,1676142225955 expired; onlineServers=1 2023-02-11 19:03:52,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/.tmp/info/99596b69e8fa4362a4b6cd20b853a9e2 2023-02-11 19:03:52,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/.tmp/info/99596b69e8fa4362a4b6cd20b853a9e2 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/info/99596b69e8fa4362a4b6cd20b853a9e2 2023-02-11 19:03:52,406 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:52,406 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:52,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/info/99596b69e8fa4362a4b6cd20b853a9e2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:03:52,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3adc064ba8379502fd26b187dfac1c1f in 36ms, sequenceid=6, compaction requested=false 2023-02-11 19:03:52,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/.tmp/info/60f4f9ad9dec42f7ac4f9d8ab3286310 2023-02-11 19:03:52,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60f4f9ad9dec42f7ac4f9d8ab3286310 2023-02-11 19:03:52,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/namespace/3adc064ba8379502fd26b187dfac1c1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:03:52,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:52,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3adc064ba8379502fd26b187dfac1c1f: Waiting for close lock at 1676142232373Running coprocessor pre-close hooks at 1676142232373Disabling compacts and flushes for region at 1676142232373Disabling writes for close at 1676142232375 (+2 ms)Obtaining lock to block concurrent updates at 1676142232375Preparing flush snapshotting stores in 3adc064ba8379502fd26b187dfac1c1f at 1676142232375Finished memstore snapshotting hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142232375Flushing stores of hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. at 1676142232378 (+3 ms)Flushing 3adc064ba8379502fd26b187dfac1c1f/info: creating writer at 1676142232378Flushing 3adc064ba8379502fd26b187dfac1c1f/info: appending metadata at 1676142232381 (+3 ms)Flushing 3adc064ba8379502fd26b187dfac1c1f/info: closing flushed file at 1676142232381Flushing 3adc064ba8379502fd26b187dfac1c1f/info: reopening flushed file at 1676142232406 (+25 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3adc064ba8379502fd26b187dfac1c1f in 36ms, sequenceid=6, compaction requested=false at 1676142232411 (+5 ms)Writing region close event to WAL at 1676142232425 (+14 ms)Running coprocessor post-close hooks at 1676142232432 (+7 ms)Closed at 1676142232432 2023-02-11 19:03:52,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142226985.3adc064ba8379502fd26b187dfac1c1f. 2023-02-11 19:03:52,442 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:03:52,568 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:52,568 INFO [RS:0;jenkins-hbase4:36693] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36693,1676142225955; zookeeper connection closed. 2023-02-11 19:03:52,568 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34d4c77c rejected from java.util.concurrent.ThreadPoolExecutor@66180322[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:52,568 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:36693-0x10044c493a20001, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:52,568 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7bf5bd6e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7bf5bd6e 2023-02-11 19:03:52,568 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31ea745f rejected from java.util.concurrent.ThreadPoolExecutor@66180322[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:52,578 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:03:52,778 DEBUG [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 19:03:52,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/.tmp/rep_barrier/db3fa61763e74c3eb28af0b16cc73513 2023-02-11 19:03:52,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db3fa61763e74c3eb28af0b16cc73513 2023-02-11 19:03:52,849 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/.tmp/table/e1fdaa93bf6a4f7cbe68662a37f03114 2023-02-11 19:03:52,852 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1fdaa93bf6a4f7cbe68662a37f03114 2023-02-11 19:03:52,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/.tmp/info/60f4f9ad9dec42f7ac4f9d8ab3286310 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/info/60f4f9ad9dec42f7ac4f9d8ab3286310 2023-02-11 19:03:52,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60f4f9ad9dec42f7ac4f9d8ab3286310 2023-02-11 19:03:52,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/info/60f4f9ad9dec42f7ac4f9d8ab3286310, entries=30, sequenceid=57, filesize=8.3 K 2023-02-11 19:03:52,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/.tmp/rep_barrier/db3fa61763e74c3eb28af0b16cc73513 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/rep_barrier/db3fa61763e74c3eb28af0b16cc73513 2023-02-11 19:03:52,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db3fa61763e74c3eb28af0b16cc73513 2023-02-11 19:03:52,862 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/rep_barrier/db3fa61763e74c3eb28af0b16cc73513, entries=10, sequenceid=57, filesize=6.1 K 2023-02-11 19:03:52,862 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/.tmp/table/e1fdaa93bf6a4f7cbe68662a37f03114 as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/table/e1fdaa93bf6a4f7cbe68662a37f03114 2023-02-11 19:03:52,865 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1fdaa93bf6a4f7cbe68662a37f03114 2023-02-11 19:03:52,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/table/e1fdaa93bf6a4f7cbe68662a37f03114, entries=13, sequenceid=57, filesize=6.1 K 2023-02-11 19:03:52,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 488ms, sequenceid=57, compaction requested=false 2023-02-11 19:03:52,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-11 19:03:52,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:52,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:52,875 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142232375Running coprocessor pre-close hooks at 1676142232375Disabling compacts and flushes for region at 1676142232375Disabling writes for close at 1676142232378 (+3 ms)Obtaining lock to block concurrent updates at 1676142232378Preparing flush snapshotting stores in 1588230740 at 1676142232378Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676142232378Flushing stores of hbase:meta,,1.1588230740 at 1676142232382 (+4 ms)Flushing 1588230740/info: creating writer at 1676142232382Flushing 1588230740/info: appending metadata at 1676142232397 (+15 ms)Flushing 1588230740/info: closing flushed file at 1676142232397Flushing 1588230740/rep_barrier: creating writer at 1676142232430 (+33 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676142232433 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676142232433Flushing 1588230740/table: creating writer at 1676142232842 (+409 ms)Flushing 1588230740/table: appending metadata at 1676142232844 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676142232844Flushing 1588230740/info: reopening flushed file at 1676142232854 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676142232858 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676142232863 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 488ms, sequenceid=57, compaction requested=false at 1676142232866 (+3 ms)Writing region close event to WAL at 1676142232871 (+5 ms)Running coprocessor post-close hooks at 1676142232874 (+3 ms)Closed at 1676142232875 (+1 ms) 2023-02-11 19:03:52,875 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:52,978 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39279,1676142225989; all regions closed. 2023-02-11 19:03:52,982 DEBUG [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/oldWALs 2023-02-11 19:03:52,982 INFO [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39279%2C1676142225989.meta:.meta(num 1676142226916) 2023-02-11 19:03:52,987 DEBUG [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/oldWALs 2023-02-11 19:03:52,987 INFO [RS:1;jenkins-hbase4:39279] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39279%2C1676142225989:(num 1676142227292) 2023-02-11 19:03:52,987 DEBUG [RS:1;jenkins-hbase4:39279] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,987 INFO [RS:1;jenkins-hbase4:39279] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:52,987 INFO [RS:1;jenkins-hbase4:39279] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:52,987 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:52,989 INFO [RS:1;jenkins-hbase4:39279] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39279 2023-02-11 19:03:52,990 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39279,1676142225989 2023-02-11 19:03:52,990 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:52,990 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fcbfee7 rejected from java.util.concurrent.ThreadPoolExecutor@3bf47dc6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:52,992 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39279,1676142225989] 2023-02-11 19:03:52,993 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39279,1676142225989; numProcessing=2 2023-02-11 19:03:52,994 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39279,1676142225989 already deleted, retry=false 2023-02-11 19:03:52,994 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39279,1676142225989 expired; onlineServers=0 2023-02-11 19:03:52,994 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40255,1676142225907' ***** 2023-02-11 19:03:52,994 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:03:52,995 DEBUG [M:0;jenkins-hbase4:40255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33070fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:52,995 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40255,1676142225907 2023-02-11 19:03:52,995 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40255,1676142225907; all regions closed. 2023-02-11 19:03:52,995 DEBUG [M:0;jenkins-hbase4:40255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:52,995 DEBUG [M:0;jenkins-hbase4:40255] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:03:52,995 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:03:52,995 DEBUG [M:0;jenkins-hbase4:40255] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:03:52,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142226153] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142226153,5,FailOnTimeoutGroup] 2023-02-11 19:03:52,995 INFO [M:0;jenkins-hbase4:40255] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:03:52,996 INFO [M:0;jenkins-hbase4:40255] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:03:52,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142226153] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142226153,5,FailOnTimeoutGroup] 2023-02-11 19:03:52,996 INFO [M:0;jenkins-hbase4:40255] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:03:52,996 DEBUG [M:0;jenkins-hbase4:40255] master.HMaster(1502): Stopping service threads 2023-02-11 19:03:52,996 INFO [M:0;jenkins-hbase4:40255] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:03:52,997 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:52,997 ERROR [M:0;jenkins-hbase4:40255] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:03:52,997 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:52,997 INFO [M:0;jenkins-hbase4:40255] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:03:52,997 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:03:52,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:52,997 DEBUG [M:0;jenkins-hbase4:40255] zookeeper.ZKUtil(398): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:03:52,998 WARN [M:0;jenkins-hbase4:40255] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:03:52,998 INFO [M:0;jenkins-hbase4:40255] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:03:52,998 INFO [M:0;jenkins-hbase4:40255] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:03:52,998 DEBUG [M:0;jenkins-hbase4:40255] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:52,998 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:52,998 DEBUG [M:0;jenkins-hbase4:40255] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:52,998 DEBUG [M:0;jenkins-hbase4:40255] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:52,998 DEBUG [M:0;jenkins-hbase4:40255] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:52,998 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-11 19:03:53,009 INFO [M:0;jenkins-hbase4:40255] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2bd499ed830947a9a853048c5ea977bd 2023-02-11 19:03:53,013 DEBUG [M:0;jenkins-hbase4:40255] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2bd499ed830947a9a853048c5ea977bd as hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2bd499ed830947a9a853048c5ea977bd 2023-02-11 19:03:53,017 INFO [M:0;jenkins-hbase4:40255] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/96d95e67-1025-f591-371f-0e45ed77bf12/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2bd499ed830947a9a853048c5ea977bd, entries=53, sequenceid=357, filesize=10.7 K 2023-02-11 19:03:53,017 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171150, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=357, compaction requested=false 2023-02-11 19:03:53,018 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:53,018 DEBUG [M:0;jenkins-hbase4:40255] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142232998Disabling compacts and flushes for region at 1676142232998Disabling writes for close at 1676142232998Obtaining lock to block concurrent updates at 1676142232998Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142232998Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171150, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676142232998Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142232999 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142233000 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142233002 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142233002Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142233014 (+12 ms)Finished flush of dataSize ~167.14 KB/171150, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=357, compaction requested=false at 1676142233017 (+3 ms)Writing region close event to WAL at 1676142233018 (+1 ms)Closed at 1676142233018 2023-02-11 19:03:53,021 INFO [M:0;jenkins-hbase4:40255] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:03:53,021 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:53,022 INFO [M:0;jenkins-hbase4:40255] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40255 2023-02-11 19:03:53,025 DEBUG [M:0;jenkins-hbase4:40255] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40255,1676142225907 already deleted, retry=false 2023-02-11 19:03:53,093 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:53,093 INFO [RS:1;jenkins-hbase4:39279] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39279,1676142225989; zookeeper connection closed. 2023-02-11 19:03:53,093 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f9ee412 rejected from java.util.concurrent.ThreadPoolExecutor@3bf47dc6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:53,093 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39279-0x10044c493a20002, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:53,093 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@574045b3 rejected from java.util.concurrent.ThreadPoolExecutor@3bf47dc6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:53,093 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@417b15d8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@417b15d8 2023-02-11 19:03:53,094 INFO [Listener at localhost/36327] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:03:53,193 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:53,193 INFO [M:0;jenkins-hbase4:40255] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40255,1676142225907; zookeeper connection closed. 2023-02-11 19:03:53,193 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47dc0a0a rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:53,194 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:40255-0x10044c493a20000, quorum=127.0.0.1:59226, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:53,194 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10865491 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:53,194 WARN [Listener at localhost/36327] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:53,198 INFO [Listener at localhost/36327] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:53,305 WARN [BP-77473730-172.31.14.131-1676142225322 heartbeating to localhost/127.0.0.1:32807] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:53,305 WARN [BP-77473730-172.31.14.131-1676142225322 heartbeating to localhost/127.0.0.1:32807] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-77473730-172.31.14.131-1676142225322 (Datanode Uuid 7105efa4-4017-4a56-b3aa-0a49b27a74c9) service to localhost/127.0.0.1:32807 2023-02-11 19:03:53,305 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/dfs/data/data3/current/BP-77473730-172.31.14.131-1676142225322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:53,306 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/dfs/data/data4/current/BP-77473730-172.31.14.131-1676142225322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:53,308 WARN [Listener at localhost/36327] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:53,312 INFO [Listener at localhost/36327] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:53,417 WARN [BP-77473730-172.31.14.131-1676142225322 heartbeating to localhost/127.0.0.1:32807] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:53,417 WARN [BP-77473730-172.31.14.131-1676142225322 heartbeating to localhost/127.0.0.1:32807] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-77473730-172.31.14.131-1676142225322 (Datanode Uuid 83c50d75-f214-45e2-9738-3a2062e91e84) service to localhost/127.0.0.1:32807 2023-02-11 19:03:53,417 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/dfs/data/data1/current/BP-77473730-172.31.14.131-1676142225322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:53,418 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/cluster_54d581c2-c083-4979-2201-99348ce640aa/dfs/data/data2/current/BP-77473730-172.31.14.131-1676142225322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:53,427 INFO [Listener at localhost/36327] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:53,547 INFO [Listener at localhost/36327] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:03:53,589 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:03:53,604 INFO [Listener at localhost/36327] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 179) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40255,1676142225907)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32807 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:32807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:32807 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:32807 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:32807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:32807 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:32807 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=635 (was 576) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=319 (was 285) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3911 (was 3989) 2023-02-11 19:03:53,614 INFO [Listener at localhost/36327] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=319, ProcessCount=167, AvailableMemoryMB=3911 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/hadoop.log.dir so I do NOT create it in target/test-data/6be256a7-80e2-be55-4797-2743fc252210 2023-02-11 19:03:53,625 WARN [Listener at localhost/36327] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/hadoop.tmp.dir so I do NOT create it in target/test-data/6be256a7-80e2-be55-4797-2743fc252210 2023-02-11 19:03:53,625 WARN [Listener at localhost/36327] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e6f379af-e48a-352a-75f8-f43ee82bb178/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 19:03:53,625 DEBUG [Listener at localhost/36327] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91, deleteOnExit=true 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/test.cache.data in system properties and HBase conf 2023-02-11 19:03:53,625 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:03:53,626 DEBUG [Listener at localhost/36327] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:53,626 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:03:53,627 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:03:53,631 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:53,632 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:53,709 WARN [Listener at localhost/36327] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:53,711 INFO [Listener at localhost/36327] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:53,718 INFO [Listener at localhost/36327] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/java.io.tmpdir/Jetty_localhost_39489_hdfs____9vg14p/webapp 2023-02-11 19:03:53,779 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:53,809 INFO [Listener at localhost/36327] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39489 2023-02-11 19:03:53,814 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:53,814 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:53,855 WARN [Listener at localhost/41507] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:53,871 WARN [Listener at localhost/41507] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:53,874 WARN [Listener at localhost/41507] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:53,875 INFO [Listener at localhost/41507] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:53,881 INFO [Listener at localhost/41507] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/java.io.tmpdir/Jetty_localhost_41097_datanode____.xhkwko/webapp 2023-02-11 19:03:53,973 INFO [Listener at localhost/41507] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41097 2023-02-11 19:03:53,980 WARN [Listener at localhost/44643] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:54,002 WARN [Listener at localhost/44643] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:54,005 WARN [Listener at localhost/44643] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:54,006 INFO [Listener at localhost/44643] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:54,013 INFO [Listener at localhost/44643] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/java.io.tmpdir/Jetty_localhost_34691_datanode____qh5mpg/webapp 2023-02-11 19:03:54,092 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5d2c70e3615e470: Processing first storage report for DS-ead20405-a4c5-47e3-b7d2-62b662120cef from datanode a6db88f9-24cd-4451-9879-7d2eb2f9aaf2 2023-02-11 19:03:54,092 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5d2c70e3615e470: from storage DS-ead20405-a4c5-47e3-b7d2-62b662120cef node DatanodeRegistration(127.0.0.1:34509, datanodeUuid=a6db88f9-24cd-4451-9879-7d2eb2f9aaf2, infoPort=38151, infoSecurePort=0, ipcPort=44643, storageInfo=lv=-57;cid=testClusterID;nsid=1205830670;c=1676142233634), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:54,092 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5d2c70e3615e470: Processing first storage report for DS-90957b42-3fb0-4728-95fd-6f75a4080a96 from datanode a6db88f9-24cd-4451-9879-7d2eb2f9aaf2 2023-02-11 19:03:54,092 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5d2c70e3615e470: from storage DS-90957b42-3fb0-4728-95fd-6f75a4080a96 node DatanodeRegistration(127.0.0.1:34509, datanodeUuid=a6db88f9-24cd-4451-9879-7d2eb2f9aaf2, infoPort=38151, infoSecurePort=0, ipcPort=44643, storageInfo=lv=-57;cid=testClusterID;nsid=1205830670;c=1676142233634), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:54,119 INFO [Listener at localhost/44643] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34691 2023-02-11 19:03:54,128 WARN [Listener at localhost/38283] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:54,228 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x412e44a223b2ce64: Processing first storage report for DS-2b4bdb2b-6445-4393-8a31-811e339ad820 from datanode cda07b68-8c8f-471d-b1e8-638332b31078 2023-02-11 19:03:54,228 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x412e44a223b2ce64: from storage DS-2b4bdb2b-6445-4393-8a31-811e339ad820 node DatanodeRegistration(127.0.0.1:42647, datanodeUuid=cda07b68-8c8f-471d-b1e8-638332b31078, infoPort=36171, infoSecurePort=0, ipcPort=38283, storageInfo=lv=-57;cid=testClusterID;nsid=1205830670;c=1676142233634), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:54,228 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x412e44a223b2ce64: Processing first storage report for DS-c2c0ec9c-2c3a-42d8-83c9-25b833a687ce from datanode cda07b68-8c8f-471d-b1e8-638332b31078 2023-02-11 19:03:54,228 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x412e44a223b2ce64: from storage DS-c2c0ec9c-2c3a-42d8-83c9-25b833a687ce node DatanodeRegistration(127.0.0.1:42647, datanodeUuid=cda07b68-8c8f-471d-b1e8-638332b31078, infoPort=36171, infoSecurePort=0, ipcPort=38283, storageInfo=lv=-57;cid=testClusterID;nsid=1205830670;c=1676142233634), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:54,234 DEBUG [Listener at localhost/38283] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210 2023-02-11 19:03:54,236 INFO [Listener at localhost/38283] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/zookeeper_0, clientPort=61269, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:03:54,237 INFO [Listener at localhost/38283] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61269 2023-02-11 19:03:54,237 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,238 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,256 INFO [Listener at localhost/38283] util.FSUtils(479): Created version file at hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126 with version=8 2023-02-11 19:03:54,256 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,257 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,258 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/hbase-staging 2023-02-11 19:03:54,259 INFO [Listener at localhost/38283] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:54,259 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,259 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,260 INFO [Listener at localhost/38283] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:54,260 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,260 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:54,260 INFO [Listener at localhost/38283] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:54,260 INFO [Listener at localhost/38283] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35651 2023-02-11 19:03:54,261 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,261 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,262 INFO [Listener at localhost/38283] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35651 connecting to ZooKeeper ensemble=127.0.0.1:61269 2023-02-11 19:03:54,271 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:356510x0, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:54,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35651-0x10044c4b4400000 connected 2023-02-11 19:03:54,287 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:54,287 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:54,287 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:54,289 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35651 2023-02-11 19:03:54,289 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35651 2023-02-11 19:03:54,290 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35651 2023-02-11 19:03:54,290 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35651 2023-02-11 19:03:54,290 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35651 2023-02-11 19:03:54,290 INFO [Listener at localhost/38283] master.HMaster(439): hbase.rootdir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126, hbase.cluster.distributed=false 2023-02-11 19:03:54,305 INFO [Listener at localhost/38283] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:54,305 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,305 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,306 INFO [Listener at localhost/38283] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:54,306 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,306 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:54,306 INFO [Listener at localhost/38283] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:54,307 INFO [Listener at localhost/38283] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34507 2023-02-11 19:03:54,307 INFO [Listener at localhost/38283] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:54,310 DEBUG [Listener at localhost/38283] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:54,310 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,311 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,312 INFO [Listener at localhost/38283] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34507 connecting to ZooKeeper ensemble=127.0.0.1:61269 2023-02-11 19:03:54,315 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:345070x0, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:54,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34507-0x10044c4b4400001 connected 2023-02-11 19:03:54,317 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:54,318 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:54,318 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:54,320 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34507 2023-02-11 19:03:54,324 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34507 2023-02-11 19:03:54,324 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34507 2023-02-11 19:03:54,324 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34507 2023-02-11 19:03:54,325 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34507 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:54,336 INFO [Listener at localhost/38283] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:54,338 INFO [Listener at localhost/38283] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43659 2023-02-11 19:03:54,338 INFO [Listener at localhost/38283] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:54,338 DEBUG [Listener at localhost/38283] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:54,339 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,340 INFO [Listener at localhost/38283] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,340 INFO [Listener at localhost/38283] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43659 connecting to ZooKeeper ensemble=127.0.0.1:61269 2023-02-11 19:03:54,344 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:436590x0, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:54,345 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): regionserver:436590x0, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:54,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43659-0x10044c4b4400002 connected 2023-02-11 19:03:54,346 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:54,346 DEBUG [Listener at localhost/38283] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:54,348 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43659 2023-02-11 19:03:54,351 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43659 2023-02-11 19:03:54,351 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43659 2023-02-11 19:03:54,352 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43659 2023-02-11 19:03:54,352 DEBUG [Listener at localhost/38283] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43659 2023-02-11 19:03:54,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,355 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:54,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,357 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:54,357 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:54,357 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,357 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:54,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:54,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:54,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35651,1676142234259 from backup master directory 2023-02-11 19:03:54,361 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,361 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:54,361 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:54,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/hbase.id with ID: 7af77313-b2d8-418f-a0f9-dc9d91341510 2023-02-11 19:03:54,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:54,382 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x21f9663a to 127.0.0.1:61269 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:54,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@507a0050, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:54,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:54,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:03:54,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:54,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store-tmp 2023-02-11 19:03:54,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:54,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:54,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:54,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:54,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:54,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:54,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:54,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142234403Disabling compacts and flushes for region at 1676142234403Disabling writes for close at 1676142234404 (+1 ms)Writing region close event to WAL at 1676142234404Closed at 1676142234404 2023-02-11 19:03:54,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/WALs/jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35651%2C1676142234259, suffix=, logDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/WALs/jenkins-hbase4.apache.org,35651,1676142234259, archiveDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/oldWALs, maxLogs=10 2023-02-11 19:03:54,419 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK] 2023-02-11 19:03:54,420 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK] 2023-02-11 19:03:54,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/WALs/jenkins-hbase4.apache.org,35651,1676142234259/jenkins-hbase4.apache.org%2C35651%2C1676142234259.1676142234407 2023-02-11 19:03:54,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK], DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK]] 2023-02-11 19:03:54,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:54,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:54,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:54,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:54,423 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:54,424 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:03:54,424 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:03:54,425 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:54,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:54,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:54,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:54,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59058872, jitterRate=-0.11995422840118408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:54,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142234422Initializing all the Stores at 1676142234423 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142234423Cleaning up temporary data from old regions at 1676142234426 (+3 ms)Cleaning up detritus from prior splits at 1676142234426Region opened successfully at 1676142234429 (+3 ms) 2023-02-11 19:03:54,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:03:54,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:03:54,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:03:54,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:03:54,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 19:03:54,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 19:03:54,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:03:54,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:03:54,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:03:54,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:03:54,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:03:54,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:03:54,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:03:54,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:03:54,450 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:03:54,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:03:54,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:03:54,452 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:54,452 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:54,452 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:54,452 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35651,1676142234259, sessionid=0x10044c4b4400000, setting cluster-up flag (Was=false) 2023-02-11 19:03:54,457 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:03:54,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,465 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:03:54,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:54,469 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.hbase-snapshot/.tmp 2023-02-11 19:03:54,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:54,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142264476 2023-02-11 19:03:54,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:03:54,477 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:03:54,477 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:03:54,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:03:54,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:03:54,478 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:54,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:03:54,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:03:54,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142234478,5,FailOnTimeoutGroup] 2023-02-11 19:03:54,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142234479,5,FailOnTimeoutGroup] 2023-02-11 19:03:54,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:03:54,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,490 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:54,491 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:54,491 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126 2023-02-11 19:03:54,497 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:54,498 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:54,499 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/info 2023-02-11 19:03:54,500 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:54,500 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,500 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:54,501 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:54,502 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:54,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:54,503 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/table 2023-02-11 19:03:54,503 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:54,503 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,504 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740 2023-02-11 19:03:54,504 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740 2023-02-11 19:03:54,506 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:54,507 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:54,508 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:54,509 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67527453, jitterRate=0.006237462162971497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:54,509 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142234498Initializing all the Stores at 1676142234498Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142234498Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142234498Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142234498Cleaning up temporary data from old regions at 1676142234505 (+7 ms)Cleaning up detritus from prior splits at 1676142234505Region opened successfully at 1676142234509 (+4 ms) 2023-02-11 19:03:54,509 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:54,509 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:54,509 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:54,509 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:54,509 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:54,509 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:54,509 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142234509Disabling compacts and flushes for region at 1676142234509Disabling writes for close at 1676142234509Writing region close event to WAL at 1676142234509Closed at 1676142234509 2023-02-11 19:03:54,510 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:54,510 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:03:54,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:03:54,512 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:03:54,513 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:03:54,554 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(952): ClusterId : 7af77313-b2d8-418f-a0f9-dc9d91341510 2023-02-11 19:03:54,554 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(952): ClusterId : 7af77313-b2d8-418f-a0f9-dc9d91341510 2023-02-11 19:03:54,554 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:54,554 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:54,557 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:54,557 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:54,557 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:54,557 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:54,559 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:54,561 DEBUG [RS:0;jenkins-hbase4:34507] zookeeper.ReadOnlyZKClient(139): Connect 0x43ef0bbc to 127.0.0.1:61269 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:54,562 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:54,563 DEBUG [RS:1;jenkins-hbase4:43659] zookeeper.ReadOnlyZKClient(139): Connect 0x094b542b to 127.0.0.1:61269 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:54,570 DEBUG [RS:0;jenkins-hbase4:34507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d28fdb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:54,570 DEBUG [RS:1;jenkins-hbase4:43659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78cab72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:54,570 DEBUG [RS:0;jenkins-hbase4:34507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@491760cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:54,570 DEBUG [RS:1;jenkins-hbase4:43659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b33f5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:54,580 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43659 2023-02-11 19:03:54,580 INFO [RS:1;jenkins-hbase4:43659] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:54,580 INFO [RS:1;jenkins-hbase4:43659] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:54,580 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:54,580 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35651,1676142234259 with isa=jenkins-hbase4.apache.org/172.31.14.131:43659, startcode=1676142234335 2023-02-11 19:03:54,580 DEBUG [RS:1;jenkins-hbase4:43659] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:54,582 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35047, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:54,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,583 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126 2023-02-11 19:03:54,584 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41507 2023-02-11 19:03:54,584 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:54,584 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34507 2023-02-11 19:03:54,584 INFO [RS:0;jenkins-hbase4:34507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:54,584 INFO [RS:0;jenkins-hbase4:34507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:54,584 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:54,585 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:54,585 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35651,1676142234259 with isa=jenkins-hbase4.apache.org/172.31.14.131:34507, startcode=1676142234305 2023-02-11 19:03:54,585 DEBUG [RS:0;jenkins-hbase4:34507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:54,585 DEBUG [RS:1;jenkins-hbase4:43659] zookeeper.ZKUtil(162): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,585 WARN [RS:1;jenkins-hbase4:43659] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:54,586 INFO [RS:1;jenkins-hbase4:43659] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:54,586 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,586 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43659,1676142234335] 2023-02-11 19:03:54,589 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33009, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:54,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,590 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126 2023-02-11 19:03:54,590 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41507 2023-02-11 19:03:54,590 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:54,596 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:54,596 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:54,596 DEBUG [RS:1;jenkins-hbase4:43659] zookeeper.ZKUtil(162): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,596 DEBUG [RS:0;jenkins-hbase4:34507] zookeeper.ZKUtil(162): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,596 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34507,1676142234305] 2023-02-11 19:03:54,596 WARN [RS:0;jenkins-hbase4:34507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:54,596 INFO [RS:0;jenkins-hbase4:34507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:54,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,597 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,598 DEBUG [RS:1;jenkins-hbase4:43659] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:54,599 INFO [RS:1;jenkins-hbase4:43659] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:54,601 DEBUG [RS:0;jenkins-hbase4:34507] zookeeper.ZKUtil(162): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,601 INFO [RS:1;jenkins-hbase4:43659] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:54,601 DEBUG [RS:0;jenkins-hbase4:34507] zookeeper.ZKUtil(162): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,601 INFO [RS:1;jenkins-hbase4:43659] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:54,602 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,602 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:54,602 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:54,602 INFO [RS:0;jenkins-hbase4:34507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:54,603 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,603 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,603 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 INFO [RS:0;jenkins-hbase4:34507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,604 DEBUG [RS:1;jenkins-hbase4:43659] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,606 INFO [RS:0;jenkins-hbase4:34507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:54,606 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,607 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:54,607 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,608 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,608 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,610 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,611 DEBUG [RS:0;jenkins-hbase4:34507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:54,612 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,612 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,613 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,622 INFO [RS:1;jenkins-hbase4:43659] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:54,622 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43659,1676142234335-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,623 INFO [RS:0;jenkins-hbase4:34507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:54,623 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34507,1676142234305-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,632 INFO [RS:1;jenkins-hbase4:43659] regionserver.Replication(203): jenkins-hbase4.apache.org,43659,1676142234335 started 2023-02-11 19:03:54,633 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43659,1676142234335, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43659, sessionid=0x10044c4b4400002 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43659,1676142234335' 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43659,1676142234335' 2023-02-11 19:03:54,633 DEBUG [RS:1;jenkins-hbase4:43659] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:54,633 INFO [RS:0;jenkins-hbase4:34507] regionserver.Replication(203): jenkins-hbase4.apache.org,34507,1676142234305 started 2023-02-11 19:03:54,634 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34507,1676142234305, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34507, sessionid=0x10044c4b4400001 2023-02-11 19:03:54,634 DEBUG [RS:1;jenkins-hbase4:43659] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34507,1676142234305' 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:54,634 DEBUG [RS:1;jenkins-hbase4:43659] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:54,634 INFO [RS:1;jenkins-hbase4:43659] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:54,634 INFO [RS:1;jenkins-hbase4:43659] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34507,1676142234305' 2023-02-11 19:03:54,634 DEBUG [RS:0;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:54,635 DEBUG [RS:0;jenkins-hbase4:34507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:54,635 DEBUG [RS:0;jenkins-hbase4:34507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:54,635 INFO [RS:0;jenkins-hbase4:34507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:54,635 INFO [RS:0;jenkins-hbase4:34507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:54,663 DEBUG [jenkins-hbase4:35651] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:03:54,663 DEBUG [jenkins-hbase4:35651] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:54,664 DEBUG [jenkins-hbase4:35651] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:54,664 DEBUG [jenkins-hbase4:35651] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:54,664 DEBUG [jenkins-hbase4:35651] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:54,665 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34507,1676142234305, state=OPENING 2023-02-11 19:03:54,666 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:03:54,667 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:54,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34507,1676142234305}] 2023-02-11 19:03:54,669 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:54,823 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:54,823 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:54,825 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56018, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:54,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:03:54,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:54,830 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34507%2C1676142234305.meta, suffix=.meta, logDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,34507,1676142234305, archiveDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/oldWALs, maxLogs=32 2023-02-11 19:03:54,843 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK] 2023-02-11 19:03:54,843 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK] 2023-02-11 19:03:54,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,34507,1676142234305/jenkins-hbase4.apache.org%2C34507%2C1676142234305.meta.1676142234831.meta 2023-02-11 19:03:54,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK], DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK]] 2023-02-11 19:03:54,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:03:54,846 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:03:54,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:03:54,847 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:54,848 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/info 2023-02-11 19:03:54,848 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/info 2023-02-11 19:03:54,849 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:54,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:54,850 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:54,850 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:54,850 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:54,851 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,851 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:54,852 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/table 2023-02-11 19:03:54,852 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/table 2023-02-11 19:03:54,852 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:54,852 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:54,853 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740 2023-02-11 19:03:54,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740 2023-02-11 19:03:54,855 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:54,856 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:54,857 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74534445, jitterRate=0.11064977943897247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:54,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142234846Writing region info on filesystem at 1676142234846Initializing all the Stores at 1676142234847 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142234847Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142234847Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142234847Cleaning up temporary data from old regions at 1676142234855 (+8 ms)Cleaning up detritus from prior splits at 1676142234855Running coprocessor post-open hooks at 1676142234857 (+2 ms)Region opened successfully at 1676142234857 2023-02-11 19:03:54,858 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142234823 2023-02-11 19:03:54,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:03:54,862 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:03:54,862 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34507,1676142234305, state=OPEN 2023-02-11 19:03:54,864 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:03:54,864 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:54,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:03:54,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34507,1676142234305 in 197 msec 2023-02-11 19:03:54,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:03:54,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-11 19:03:54,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-11 19:03:54,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142234355, completionTime=-1 2023-02-11 19:03:54,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:03:54,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:03:54,870 DEBUG [hconnection-0x601dbfb6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:54,872 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:54,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:03:54,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142294873 2023-02-11 19:03:54,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142354873 2023-02-11 19:03:54,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 19:03:54,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35651,1676142234259-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35651,1676142234259-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35651,1676142234259-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35651, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:54,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:03:54,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:54,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:03:54,881 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:03:54,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:54,882 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:54,883 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:54,884 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3 empty. 2023-02-11 19:03:54,884 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:54,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:03:54,893 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:54,894 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 31ff072bdbc191ee53741a20433a1be3, NAME => 'hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp 2023-02-11 19:03:54,902 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:54,902 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 31ff072bdbc191ee53741a20433a1be3, disabling compactions & flushes 2023-02-11 19:03:54,902 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:54,902 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:54,902 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. after waiting 0 ms 2023-02-11 19:03:54,902 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:54,902 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:54,902 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 31ff072bdbc191ee53741a20433a1be3: Waiting for close lock at 1676142234902Disabling compacts and flushes for region at 1676142234902Disabling writes for close at 1676142234902Writing region close event to WAL at 1676142234902Closed at 1676142234902 2023-02-11 19:03:54,904 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:54,905 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142234904"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142234904"}]},"ts":"1676142234904"} 2023-02-11 19:03:54,907 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:54,908 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:54,908 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142234908"}]},"ts":"1676142234908"} 2023-02-11 19:03:54,909 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:03:54,913 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:54,914 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:54,914 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:54,914 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:54,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=31ff072bdbc191ee53741a20433a1be3, ASSIGN}] 2023-02-11 19:03:54,916 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=31ff072bdbc191ee53741a20433a1be3, ASSIGN 2023-02-11 19:03:54,917 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=31ff072bdbc191ee53741a20433a1be3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34507,1676142234305; forceNewPlan=false, retain=false 2023-02-11 19:03:55,067 INFO [jenkins-hbase4:35651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:55,067 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=31ff072bdbc191ee53741a20433a1be3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:55,067 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142235067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142235067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142235067"}]},"ts":"1676142235067"} 2023-02-11 19:03:55,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 31ff072bdbc191ee53741a20433a1be3, server=jenkins-hbase4.apache.org,34507,1676142234305}] 2023-02-11 19:03:55,223 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:55,225 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34507%2C1676142234305, suffix=, logDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,34507,1676142234305, archiveDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/oldWALs, maxLogs=32 2023-02-11 19:03:55,240 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK] 2023-02-11 19:03:55,240 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK] 2023-02-11 19:03:55,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,34507,1676142234305/jenkins-hbase4.apache.org%2C34507%2C1676142234305.1676142235225 2023-02-11 19:03:55,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK], DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK]] 2023-02-11 19:03:55,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31ff072bdbc191ee53741a20433a1be3, NAME => 'hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:55,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:55,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,246 INFO [StoreOpener-31ff072bdbc191ee53741a20433a1be3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,247 DEBUG [StoreOpener-31ff072bdbc191ee53741a20433a1be3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/info 2023-02-11 19:03:55,247 DEBUG [StoreOpener-31ff072bdbc191ee53741a20433a1be3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/info 2023-02-11 19:03:55,247 INFO [StoreOpener-31ff072bdbc191ee53741a20433a1be3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ff072bdbc191ee53741a20433a1be3 columnFamilyName info 2023-02-11 19:03:55,248 INFO [StoreOpener-31ff072bdbc191ee53741a20433a1be3-1] regionserver.HStore(310): Store=31ff072bdbc191ee53741a20433a1be3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:55,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:55,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:55,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31ff072bdbc191ee53741a20433a1be3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64351721, jitterRate=-0.04108463227748871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:55,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31ff072bdbc191ee53741a20433a1be3: Running coprocessor pre-open hook at 1676142235243Writing region info on filesystem at 1676142235243Initializing all the Stores at 1676142235244 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142235244Cleaning up temporary data from old regions at 1676142235249 (+5 ms)Cleaning up detritus from prior splits at 1676142235249Running coprocessor post-open hooks at 1676142235253 (+4 ms)Region opened successfully at 1676142235253 2023-02-11 19:03:55,254 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3., pid=6, masterSystemTime=1676142235220 2023-02-11 19:03:55,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:55,257 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:55,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=31ff072bdbc191ee53741a20433a1be3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:55,257 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142235257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142235257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142235257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142235257"}]},"ts":"1676142235257"} 2023-02-11 19:03:55,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:03:55,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 31ff072bdbc191ee53741a20433a1be3, server=jenkins-hbase4.apache.org,34507,1676142234305 in 189 msec 2023-02-11 19:03:55,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:03:55,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=31ff072bdbc191ee53741a20433a1be3, ASSIGN in 346 msec 2023-02-11 19:03:55,262 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:55,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142235262"}]},"ts":"1676142235262"} 2023-02-11 19:03:55,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:03:55,269 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:55,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 389 msec 2023-02-11 19:03:55,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:03:55,282 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:55,282 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:55,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:03:55,297 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:55,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-11 19:03:55,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:03:55,313 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:03:55,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-11 19:03:55,325 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:03:55,327 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:03:55,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.966sec 2023-02-11 19:03:55,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:03:55,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:03:55,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:03:55,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35651,1676142234259-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:03:55,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35651,1676142234259-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:03:55,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:03:55,355 DEBUG [Listener at localhost/38283] zookeeper.ReadOnlyZKClient(139): Connect 0x6469c336 to 127.0.0.1:61269 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:55,361 DEBUG [Listener at localhost/38283] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fa57418, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:55,363 DEBUG [hconnection-0x660a1955-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:55,365 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56024, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:55,366 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:55,366 DEBUG [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:03:55,368 DEBUG [Listener at localhost/38283] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:03:55,370 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:03:55,370 INFO [Listener at localhost/38283] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-11 19:03:55,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-11 19:03:55,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:03:55,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:60076 deadline: 1676142295371, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-11 19:03:55,372 INFO [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-11 19:03:55,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:55,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:55,376 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:55,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-11 19:03:55,377 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:55,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:55,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,379 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad empty. 2023-02-11 19:03:55,379 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,379 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-11 19:03:55,388 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:55,389 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2264975534ffebe63f5585af56d6c9ad, NAME => 'testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp 2023-02-11 19:03:55,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:55,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 2264975534ffebe63f5585af56d6c9ad, disabling compactions & flushes 2023-02-11 19:03:55,395 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. after waiting 0 ms 2023-02-11 19:03:55,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,395 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2264975534ffebe63f5585af56d6c9ad: Waiting for close lock at 1676142235395Disabling compacts and flushes for region at 1676142235395Disabling writes for close at 1676142235395Writing region close event to WAL at 1676142235395Closed at 1676142235395 2023-02-11 19:03:55,397 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:55,398 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676142235398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142235398"}]},"ts":"1676142235398"} 2023-02-11 19:03:55,399 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:55,401 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:55,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142235401"}]},"ts":"1676142235401"} 2023-02-11 19:03:55,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-11 19:03:55,405 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:55,406 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:55,406 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:55,406 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:55,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, ASSIGN}] 2023-02-11 19:03:55,408 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, ASSIGN 2023-02-11 19:03:55,409 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43659,1676142234335; forceNewPlan=false, retain=false 2023-02-11 19:03:55,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:55,559 INFO [jenkins-hbase4:35651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:55,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2264975534ffebe63f5585af56d6c9ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:55,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676142235560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142235560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142235560"}]},"ts":"1676142235560"} 2023-02-11 19:03:55,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2264975534ffebe63f5585af56d6c9ad, server=jenkins-hbase4.apache.org,43659,1676142234335}] 2023-02-11 19:03:55,635 INFO [RS:1;jenkins-hbase4:43659] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43659%2C1676142234335, suffix=, logDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,43659,1676142234335, archiveDir=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/oldWALs, maxLogs=32 2023-02-11 19:03:55,652 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK] 2023-02-11 19:03:55,652 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK] 2023-02-11 19:03:55,653 INFO [RS:1;jenkins-hbase4:43659] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/WALs/jenkins-hbase4.apache.org,43659,1676142234335/jenkins-hbase4.apache.org%2C43659%2C1676142234335.1676142235636 2023-02-11 19:03:55,654 DEBUG [RS:1;jenkins-hbase4:43659] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34509,DS-ead20405-a4c5-47e3-b7d2-62b662120cef,DISK], DatanodeInfoWithStorage[127.0.0.1:42647,DS-2b4bdb2b-6445-4393-8a31-811e339ad820,DISK]] 2023-02-11 19:03:55,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:55,715 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:55,715 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:55,716 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51464, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:55,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2264975534ffebe63f5585af56d6c9ad, NAME => 'testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:55,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:55,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,720 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,722 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1 2023-02-11 19:03:55,722 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1 2023-02-11 19:03:55,722 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2264975534ffebe63f5585af56d6c9ad columnFamilyName f1 2023-02-11 19:03:55,722 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(310): Store=2264975534ffebe63f5585af56d6c9ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:55,722 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,723 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2 2023-02-11 19:03:55,724 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2 2023-02-11 19:03:55,724 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2264975534ffebe63f5585af56d6c9ad columnFamilyName f2 2023-02-11 19:03:55,724 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(310): Store=2264975534ffebe63f5585af56d6c9ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:55,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:55,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:55,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:55,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2264975534ffebe63f5585af56d6c9ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62247680, jitterRate=-0.07243728637695312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:55,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2264975534ffebe63f5585af56d6c9ad: Running coprocessor pre-open hook at 1676142235719Writing region info on filesystem at 1676142235719Initializing all the Stores at 1676142235720 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142235720Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142235720Cleaning up temporary data from old regions at 1676142235726 (+6 ms)Cleaning up detritus from prior splits at 1676142235726Running coprocessor post-open hooks at 1676142235730 (+4 ms)Region opened successfully at 1676142235730 2023-02-11 19:03:55,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad., pid=12, masterSystemTime=1676142235715 2023-02-11 19:03:55,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:55,737 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2264975534ffebe63f5585af56d6c9ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:55,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676142235737"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142235737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142235737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142235737"}]},"ts":"1676142235737"} 2023-02-11 19:03:55,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 19:03:55,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2264975534ffebe63f5585af56d6c9ad, server=jenkins-hbase4.apache.org,43659,1676142234335 in 177 msec 2023-02-11 19:03:55,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 19:03:55,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, ASSIGN in 333 msec 2023-02-11 19:03:55,743 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:03:55,743 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142235743"}]},"ts":"1676142235743"} 2023-02-11 19:03:55,744 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-11 19:03:55,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:03:55,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 373 msec 2023-02-11 19:03:55,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:03:55,982 INFO [Listener at localhost/38283] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-11 19:03:55,982 DEBUG [Listener at localhost/38283] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-11 19:03:55,982 INFO [Listener at localhost/38283] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:55,985 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-11 19:03:55,985 INFO [Listener at localhost/38283] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:03:55,985 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-11 19:03:55,985 INFO [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:03:56,004 DEBUG [hconnection-0x660a1955-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:56,024 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51466, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:56,030 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43659] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,137 INFO [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:03:56,138 INFO [Listener at localhost/38283] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:03:56,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 19:03:56,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142236139 (current time:1676142236139). 2023-02-11 19:03:56,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:03:56,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] zookeeper.ReadOnlyZKClient(139): Connect 0x462b3a18 to 127.0.0.1:61269 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51886aba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:56,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:56,144 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:56,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x462b3a18 to 127.0.0.1:61269 2023-02-11 19:03:56,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:56,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:03:56,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 19:03:56,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 19:03:56,149 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 19:03:56,150 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676142836150 2023-02-11 19:03:56,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 19:03:56,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,151 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:56,152 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:03:56,152 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 19:03:56,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 19:03:56,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-11 19:03:56,153 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 19:03:56,154 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676142836154 2023-02-11 19:03:56,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,168 INFO [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-11 19:03:56,168 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:56,169 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-11 19:03:56,169 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 19:03:56,169 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,169 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,171 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:56,171 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:56,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:56,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:56,171 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,171 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,171 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-11 19:03:56,173 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-11 19:03:56,173 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:56,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,177 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 19:03:56,177 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 19:03:56,177 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34507,1676142234305' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 19:03:56,177 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-11 19:03:56,177 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:03:56,178 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 19:03:56,178 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 19:03:56,178 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43659,1676142234335' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 19:03:56,179 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,179 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,179 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,180 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:56,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43659,1676142234335' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-11 19:03:56,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41997a7e[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:56,182 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 19:03:56,182 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,184 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,184 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,184 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,184 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 19:03:56,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 19:03:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:03:56,188 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 19:03:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 19:03:56,188 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. started... 2023-02-11 19:03:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34507,1676142234305' in zk 2023-02-11 19:03:56,188 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2264975534ffebe63f5585af56d6c9ad 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 19:03:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 19:03:56,190 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:56,190 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 19:03:56,204 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f1/aed6eb131dff45f4b0dcf91da6a74268 2023-02-11 19:03:56,221 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f2/e9b8d26f23ab4c9cbda877aa868af4bc 2023-02-11 19:03:56,225 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f1/aed6eb131dff45f4b0dcf91da6a74268 as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/aed6eb131dff45f4b0dcf91da6a74268 2023-02-11 19:03:56,229 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/aed6eb131dff45f4b0dcf91da6a74268, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:03:56,229 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f2/e9b8d26f23ab4c9cbda877aa868af4bc as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/e9b8d26f23ab4c9cbda877aa868af4bc 2023-02-11 19:03:56,233 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/e9b8d26f23ab4c9cbda877aa868af4bc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:03:56,234 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2264975534ffebe63f5585af56d6c9ad in 46ms, sequenceid=5, compaction requested=false 2023-02-11 19:03:56,234 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-11 19:03:56,234 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2264975534ffebe63f5585af56d6c9ad: 2023-02-11 19:03:56,235 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,235 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:03:56,235 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/aed6eb131dff45f4b0dcf91da6a74268] hfiles 2023-02-11 19:03:56,235 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/aed6eb131dff45f4b0dcf91da6a74268 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,235 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/e9b8d26f23ab4c9cbda877aa868af4bc] hfiles 2023-02-11 19:03:56,235 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/e9b8d26f23ab4c9cbda877aa868af4bc for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,240 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. completed. 2023-02-11 19:03:56,240 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 19:03:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 19:03:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 19:03:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43659,1676142234335' in zk 2023-02-11 19:03:56,242 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 19:03:56,242 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:56,242 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,242 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 19:03:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,43659,1676142234335': 2023-02-11 19:03:56,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43659,1676142234335' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 19:03:56,245 INFO [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-11 19:03:56,245 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:56,245 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:56,245 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,245 INFO [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:03:56,247 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,247 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:03:56,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,247 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:56,247 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,247 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,249 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:56,249 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:56,250 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,251 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,252 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:56,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-11 19:03:56,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:03:56,253 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:03:56,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,257 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:03:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:56,257 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,258 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:56,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,258 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:03:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:56,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-11 19:03:56,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,305 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676142236150Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676142236257 (+107 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676142236257Writing data manifest for testWithMockedMapReduceSingleRegion at 1676142236260 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676142236266 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676142236304 (+38 ms) 2023-02-11 19:03:56,307 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 19:03:56,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 156 msec 2023-02-11 19:03:56,453 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:03:56,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-11 19:03:56,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:03:56,455 INFO [Listener at localhost/38283] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:03:56,459 INFO [Listener at localhost/38283] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:03:56,464 INFO [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:03:56,492 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43659] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,574 INFO [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:03:56,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:03:56,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,581 INFO [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-11 19:03:56,581 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:56,582 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-11 19:03:56,582 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 19:03:56,582 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,582 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,584 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:56,584 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:56,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:56,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:56,584 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,584 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,584 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:03:56,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,585 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-11 19:03:56,585 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:56,585 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-11 19:03:56,585 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:03:56,586 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 19:03:56,586 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 19:03:56,586 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 19:03:56,586 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34507,1676142234305' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 19:03:56,587 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:03:56,587 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:03:56,587 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,587 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. started... 2023-02-11 19:03:56,587 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2264975534ffebe63f5585af56d6c9ad 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 19:03:56,588 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,588 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,588 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:56,601 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f1/76d741e67a5e4fbfa21668bb8fc7201d 2023-02-11 19:03:56,618 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f2/50677bf830df424aaec6dc0edda4d31a 2023-02-11 19:03:56,623 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f1/76d741e67a5e4fbfa21668bb8fc7201d as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/76d741e67a5e4fbfa21668bb8fc7201d 2023-02-11 19:03:56,627 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/76d741e67a5e4fbfa21668bb8fc7201d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:03:56,628 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/.tmp/f2/50677bf830df424aaec6dc0edda4d31a as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/50677bf830df424aaec6dc0edda4d31a 2023-02-11 19:03:56,633 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/50677bf830df424aaec6dc0edda4d31a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:03:56,634 INFO [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2264975534ffebe63f5585af56d6c9ad in 47ms, sequenceid=9, compaction requested=false 2023-02-11 19:03:56,635 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2264975534ffebe63f5585af56d6c9ad: 2023-02-11 19:03:56,635 DEBUG [rs(jenkins-hbase4.apache.org,43659,1676142234335)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:03:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:03:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 19:03:56,635 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43659,1676142234335' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 19:03:56,638 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,638 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:56,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:56,639 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,639 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:03:56,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:56,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:56,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:56,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43659,1676142234335' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-11 19:03:56,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45a6e695[Count = 0] remaining members to acquire global barrier 2023-02-11 19:03:56,641 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 19:03:56,641 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,642 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 19:03:56,642 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 19:03:56,642 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,642 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 19:03:56,642 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 19:03:56,642 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34507,1676142234305' in zk 2023-02-11 19:03:56,642 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:03:56,642 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,43659,1676142234335' in zk 2023-02-11 19:03:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 19:03:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:56,644 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,34507,1676142234305' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 19:03:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 19:03:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,43659,1676142234335' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 19:03:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,43659,1676142234335': 2023-02-11 19:03:56,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43659,1676142234335' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 19:03:56,647 INFO [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-11 19:03:56,647 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:03:56,647 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:03:56,647 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,647 INFO [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:03:56,649 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:56,649 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:56,649 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:03:56,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:56,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:56,649 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:03:56,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,650 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:03:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,651 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,651 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:03:56,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:56,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-11 19:03:56,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:03:56,654 DEBUG [(jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:56,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:03:56,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:03:56,655 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-11 19:03:56,655 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:03:56,654 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion because node does not exist (not an error) 2023-02-11 19:03:56,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:56,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:56,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:03:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:56,755 DEBUG [Listener at localhost/38283] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:03:56,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:03:56,760 INFO [Listener at localhost/38283] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676142236139 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:56,761 DEBUG [Listener at localhost/38283] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13/data/default/testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,761 INFO [Listener at localhost/38283] snapshot.RestoreSnapshotHelper(239): region to add: 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:56,761 INFO [Listener at localhost/38283] snapshot.RestoreSnapshotHelper(585): clone region=2264975534ffebe63f5585af56d6c9ad as 2264975534ffebe63f5585af56d6c9ad in snapshot testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,762 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2264975534ffebe63f5585af56d6c9ad, NAME => 'testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13 2023-02-11 19:03:56,768 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:56,768 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aed6eb131dff45f4b0dcf91da6a74268 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,770 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9b8d26f23ab4c9cbda877aa868af4bc from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,772 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2264975534ffebe63f5585af56d6c9ad, disabling compactions & flushes 2023-02-11 19:03:56,772 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,772 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,772 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. after waiting 0 ms 2023-02-11 19:03:56,772 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,772 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,772 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2264975534ffebe63f5585af56d6c9ad: Waiting for close lock at 1676142236772Disabling compacts and flushes for region at 1676142236772Disabling writes for close at 1676142236772Writing region close event to WAL at 1676142236772Closed at 1676142236772 2023-02-11 19:03:56,772 INFO [Listener at localhost/38283] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676142236139 type: FLUSH version: 2 ttl: 0 2023-02-11 19:03:56,772 DEBUG [Listener at localhost/38283] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13 2023-02-11 19:03:56,772 DEBUG [Listener at localhost/38283] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13 2023-02-11 19:03:56,773 DEBUG [Listener at localhost/38283] util.CommonFSUtils(699): |-data/ 2023-02-11 19:03:56,773 DEBUG [Listener at localhost/38283] util.CommonFSUtils(699): |----default/ 2023-02-11 19:03:56,773 DEBUG [Listener at localhost/38283] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-11 19:03:56,774 DEBUG [Listener at localhost/38283] util.CommonFSUtils(699): |----------2264975534ffebe63f5585af56d6c9ad/ 2023-02-11 19:03:56,774 DEBUG [Listener at localhost/38283] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:03:56,774 DEBUG [Listener at localhost/38283] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:03:56,774 DEBUG [Listener at localhost/38283] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=2264975534ffebe63f5585af56d6c9ad-aed6eb131dff45f4b0dcf91da6a74268 2023-02-11 19:03:56,774 DEBUG [Listener at localhost/38283] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:03:56,775 DEBUG [Listener at localhost/38283] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=2264975534ffebe63f5585af56d6c9ad-e9b8d26f23ab4c9cbda877aa868af4bc 2023-02-11 19:03:56,777 INFO [Listener at localhost/38283] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 19:03:56,780 DEBUG [Listener at localhost/38283] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:56,780 INFO [Listener at localhost/38283] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:03:56,781 DEBUG [Listener at localhost/38283] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:56,783 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:56,784 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1 2023-02-11 19:03:56,784 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2264975534ffebe63f5585af56d6c9ad columnFamilyName f1 2023-02-11 19:03:56,788 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(539): loaded hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/testWithMockedMapReduceSingleRegion=2264975534ffebe63f5585af56d6c9ad-aed6eb131dff45f4b0dcf91da6a74268 2023-02-11 19:03:56,788 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(310): Store=2264975534ffebe63f5585af56d6c9ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:56,788 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:56,788 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2 2023-02-11 19:03:56,789 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2264975534ffebe63f5585af56d6c9ad columnFamilyName f2 2023-02-11 19:03:56,792 DEBUG [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(539): loaded hdfs://localhost:41507/user/jenkins/test-data/0660fc41-ec78-7ea7-291d-149c44764447/testWithMockedMapReduceSingleRegion/c56c3a49-b7fa-4f80-923b-3d579e09ba13/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/testWithMockedMapReduceSingleRegion=2264975534ffebe63f5585af56d6c9ad-e9b8d26f23ab4c9cbda877aa868af4bc 2023-02-11 19:03:56,792 INFO [StoreOpener-2264975534ffebe63f5585af56d6c9ad-1] regionserver.HStore(310): Store=2264975534ffebe63f5585af56d6c9ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:56,792 DEBUG [Listener at localhost/38283] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:03:56,793 INFO [Listener at localhost/38283] regionserver.HRegion(1071): Opened 2264975534ffebe63f5585af56d6c9ad; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64834504, jitterRate=-0.033890604972839355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:03:56,793 DEBUG [Listener at localhost/38283] regionserver.HRegion(964): Region open journal for 2264975534ffebe63f5585af56d6c9ad: Writing region info on filesystem at 1676142236781Initializing all the Stores at 1676142236782 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142236782Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142236782Region opened successfully at 1676142236793 (+11 ms) 2023-02-11 19:03:56,843 DEBUG [Listener at localhost/38283] regionserver.HRegion(1603): Closing 2264975534ffebe63f5585af56d6c9ad, disabling compactions & flushes 2023-02-11 19:03:56,843 INFO [Listener at localhost/38283] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,843 DEBUG [Listener at localhost/38283] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,843 DEBUG [Listener at localhost/38283] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. after waiting 0 ms 2023-02-11 19:03:56,843 DEBUG [Listener at localhost/38283] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,844 INFO [Listener at localhost/38283] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:56,844 DEBUG [Listener at localhost/38283] regionserver.HRegion(1557): Region close journal for 2264975534ffebe63f5585af56d6c9ad: Waiting for close lock at 1676142236843Disabling compacts and flushes for region at 1676142236843Disabling writes for close at 1676142236843Writing region close event to WAL at 1676142236844 (+1 ms)Closed at 1676142236844 2023-02-11 19:03:56,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-11 19:03:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,852 INFO [Listener at localhost/38283] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:56,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:03:56,856 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142236856"}]},"ts":"1676142236856"} 2023-02-11 19:03:56,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-11 19:03:56,858 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-11 19:03:56,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, UNASSIGN}] 2023-02-11 19:03:56,860 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, UNASSIGN 2023-02-11 19:03:56,861 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2264975534ffebe63f5585af56d6c9ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:56,861 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676142236861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142236861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142236861"}]},"ts":"1676142236861"} 2023-02-11 19:03:56,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2264975534ffebe63f5585af56d6c9ad, server=jenkins-hbase4.apache.org,43659,1676142234335}] 2023-02-11 19:03:56,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:03:57,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:57,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2264975534ffebe63f5585af56d6c9ad, disabling compactions & flushes 2023-02-11 19:03:57,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:57,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:57,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. after waiting 0 ms 2023-02-11 19:03:57,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:57,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:03:57,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad. 2023-02-11 19:03:57,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2264975534ffebe63f5585af56d6c9ad: Waiting for close lock at 1676142237014Running coprocessor pre-close hooks at 1676142237014Disabling compacts and flushes for region at 1676142237014Disabling writes for close at 1676142237014Writing region close event to WAL at 1676142237015 (+1 ms)Running coprocessor post-close hooks at 1676142237019 (+4 ms)Closed at 1676142237019 2023-02-11 19:03:57,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:57,021 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2264975534ffebe63f5585af56d6c9ad, regionState=CLOSED 2023-02-11 19:03:57,021 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676142237021"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142237021"}]},"ts":"1676142237021"} 2023-02-11 19:03:57,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 19:03:57,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2264975534ffebe63f5585af56d6c9ad, server=jenkins-hbase4.apache.org,43659,1676142234335 in 160 msec 2023-02-11 19:03:57,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 19:03:57,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2264975534ffebe63f5585af56d6c9ad, UNASSIGN in 164 msec 2023-02-11 19:03:57,025 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142237025"}]},"ts":"1676142237025"} 2023-02-11 19:03:57,026 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-11 19:03:57,027 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-11 19:03:57,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-11 19:03:57,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:03:57,159 INFO [Listener at localhost/38283] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-11 19:03:57,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:03:57,165 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:57,166 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1, FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2, FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/recovered.edits] 2023-02-11 19:03:57,169 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/76d741e67a5e4fbfa21668bb8fc7201d to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/archive/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/76d741e67a5e4fbfa21668bb8fc7201d 2023-02-11 19:03:57,170 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/aed6eb131dff45f4b0dcf91da6a74268 to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/archive/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f1/aed6eb131dff45f4b0dcf91da6a74268 2023-02-11 19:03:57,173 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/50677bf830df424aaec6dc0edda4d31a to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/archive/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/50677bf830df424aaec6dc0edda4d31a 2023-02-11 19:03:57,174 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/e9b8d26f23ab4c9cbda877aa868af4bc to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/archive/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/f2/e9b8d26f23ab4c9cbda877aa868af4bc 2023-02-11 19:03:57,176 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/recovered.edits/12.seqid to hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/archive/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad/recovered.edits/12.seqid 2023-02-11 19:03:57,176 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/.tmp/data/default/testWithMockedMapReduceSingleRegion/2264975534ffebe63f5585af56d6c9ad 2023-02-11 19:03:57,176 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-11 19:03:57,178 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,179 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-11 19:03:57,180 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-11 19:03:57,181 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,181 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-11 19:03:57,181 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142237181"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:57,182 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 19:03:57,182 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2264975534ffebe63f5585af56d6c9ad, NAME => 'testWithMockedMapReduceSingleRegion,,1676142235374.2264975534ffebe63f5585af56d6c9ad.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 19:03:57,182 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-11 19:03:57,182 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676142237182"}]},"ts":"9223372036854775807"} 2023-02-11 19:03:57,184 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-11 19:03:57,185 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 19:03:57,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-11 19:03:57,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35651] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:03:57,265 INFO [Listener at localhost/38283] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-11 19:03:57,265 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:03:57,265 INFO [Listener at localhost/38283] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:03:57,265 DEBUG [Listener at localhost/38283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6469c336 to 127.0.0.1:61269 2023-02-11 19:03:57,265 DEBUG [Listener at localhost/38283] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,265 DEBUG [Listener at localhost/38283] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:03:57,265 DEBUG [Listener at localhost/38283] util.JVMClusterUtil(257): Found active master hash=1330163446, stopped=false 2023-02-11 19:03:57,265 INFO [Listener at localhost/38283] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:57,269 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:57,269 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:57,269 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:57,269 INFO [Listener at localhost/38283] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:03:57,269 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:57,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:57,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:57,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:57,270 DEBUG [Listener at localhost/38283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21f9663a to 127.0.0.1:61269 2023-02-11 19:03:57,271 DEBUG [Listener at localhost/38283] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,271 INFO [Listener at localhost/38283] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34507,1676142234305' ***** 2023-02-11 19:03:57,271 INFO [Listener at localhost/38283] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:57,271 INFO [Listener at localhost/38283] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43659,1676142234335' ***** 2023-02-11 19:03:57,271 INFO [Listener at localhost/38283] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:03:57,271 INFO [RS:0;jenkins-hbase4:34507] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:57,271 INFO [RS:0;jenkins-hbase4:34507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:57,271 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:57,271 INFO [RS:0;jenkins-hbase4:34507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:57,271 INFO [RS:1;jenkins-hbase4:43659] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:03:57,272 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(3304): Received CLOSE for 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:57,272 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:03:57,272 INFO [RS:1;jenkins-hbase4:43659] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:03:57,273 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:57,273 INFO [RS:1;jenkins-hbase4:43659] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:03:57,273 DEBUG [RS:0;jenkins-hbase4:34507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43ef0bbc to 127.0.0.1:61269 2023-02-11 19:03:57,273 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:57,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31ff072bdbc191ee53741a20433a1be3, disabling compactions & flushes 2023-02-11 19:03:57,273 DEBUG [RS:1;jenkins-hbase4:43659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x094b542b to 127.0.0.1:61269 2023-02-11 19:03:57,273 DEBUG [RS:1;jenkins-hbase4:43659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,273 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43659,1676142234335; all regions closed. 2023-02-11 19:03:57,273 DEBUG [RS:0;jenkins-hbase4:34507] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:57,273 INFO [RS:0;jenkins-hbase4:34507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:57,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:57,274 INFO [RS:0;jenkins-hbase4:34507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:57,274 INFO [RS:0;jenkins-hbase4:34507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:57,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. after waiting 0 ms 2023-02-11 19:03:57,274 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:03:57,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:57,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 31ff072bdbc191ee53741a20433a1be3 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:03:57,274 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 19:03:57,274 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1479): Online Regions={31ff072bdbc191ee53741a20433a1be3=hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 19:03:57,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:57,274 DEBUG [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1505): Waiting on 1588230740, 31ff072bdbc191ee53741a20433a1be3 2023-02-11 19:03:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:57,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:57,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:57,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-11 19:03:57,277 DEBUG [RS:1;jenkins-hbase4:43659] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/oldWALs 2023-02-11 19:03:57,277 INFO [RS:1;jenkins-hbase4:43659] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43659%2C1676142234335:(num 1676142235636) 2023-02-11 19:03:57,277 DEBUG [RS:1;jenkins-hbase4:43659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,278 INFO [RS:1;jenkins-hbase4:43659] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:57,278 INFO [RS:1;jenkins-hbase4:43659] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:57,278 INFO [RS:1;jenkins-hbase4:43659] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:03:57,278 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:57,278 INFO [RS:1;jenkins-hbase4:43659] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:03:57,278 INFO [RS:1;jenkins-hbase4:43659] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:03:57,279 INFO [RS:1;jenkins-hbase4:43659] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43659 2023-02-11 19:03:57,282 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:57,282 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43659,1676142234335 2023-02-11 19:03:57,282 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:57,283 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@758e23a rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,283 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:57,283 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:57,283 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37e0d171 rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,283 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43659,1676142234335] 2023-02-11 19:03:57,283 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43659,1676142234335; numProcessing=1 2023-02-11 19:03:57,285 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43659,1676142234335 already deleted, retry=false 2023-02-11 19:03:57,285 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43659,1676142234335 expired; onlineServers=1 2023-02-11 19:03:57,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/.tmp/info/56a1467ffbba42dfb0fa2b0ab1d84fc5 2023-02-11 19:03:57,286 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/.tmp/info/d2acbab8bb784037824b74fc11de76af 2023-02-11 19:03:57,290 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2acbab8bb784037824b74fc11de76af 2023-02-11 19:03:57,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/.tmp/info/56a1467ffbba42dfb0fa2b0ab1d84fc5 as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/info/56a1467ffbba42dfb0fa2b0ab1d84fc5 2023-02-11 19:03:57,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/info/56a1467ffbba42dfb0fa2b0ab1d84fc5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:03:57,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 31ff072bdbc191ee53741a20433a1be3 in 21ms, sequenceid=6, compaction requested=false 2023-02-11 19:03:57,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/.tmp/rep_barrier/560d9ba15ea34e5d9fe4bfb7933abfe8 2023-02-11 19:03:57,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/namespace/31ff072bdbc191ee53741a20433a1be3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:03:57,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:57,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31ff072bdbc191ee53741a20433a1be3: Waiting for close lock at 1676142237273Running coprocessor pre-close hooks at 1676142237273Disabling compacts and flushes for region at 1676142237273Disabling writes for close at 1676142237274 (+1 ms)Obtaining lock to block concurrent updates at 1676142237274Preparing flush snapshotting stores in 31ff072bdbc191ee53741a20433a1be3 at 1676142237274Finished memstore snapshotting hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142237274Flushing stores of hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. at 1676142237274Flushing 31ff072bdbc191ee53741a20433a1be3/info: creating writer at 1676142237275 (+1 ms)Flushing 31ff072bdbc191ee53741a20433a1be3/info: appending metadata at 1676142237277 (+2 ms)Flushing 31ff072bdbc191ee53741a20433a1be3/info: closing flushed file at 1676142237278 (+1 ms)Flushing 31ff072bdbc191ee53741a20433a1be3/info: reopening flushed file at 1676142237291 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 31ff072bdbc191ee53741a20433a1be3 in 21ms, sequenceid=6, compaction requested=false at 1676142237295 (+4 ms)Writing region close event to WAL at 1676142237299 (+4 ms)Running coprocessor post-close hooks at 1676142237302 (+3 ms)Closed at 1676142237302 2023-02-11 19:03:57,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 560d9ba15ea34e5d9fe4bfb7933abfe8 2023-02-11 19:03:57,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142234879.31ff072bdbc191ee53741a20433a1be3. 2023-02-11 19:03:57,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/.tmp/table/2ed4ec05db004016983bd751ae57bb46 2023-02-11 19:03:57,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ed4ec05db004016983bd751ae57bb46 2023-02-11 19:03:57,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/.tmp/info/d2acbab8bb784037824b74fc11de76af as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/info/d2acbab8bb784037824b74fc11de76af 2023-02-11 19:03:57,317 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2acbab8bb784037824b74fc11de76af 2023-02-11 19:03:57,317 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/info/d2acbab8bb784037824b74fc11de76af, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 19:03:57,318 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/.tmp/rep_barrier/560d9ba15ea34e5d9fe4bfb7933abfe8 as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/rep_barrier/560d9ba15ea34e5d9fe4bfb7933abfe8 2023-02-11 19:03:57,318 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:57,321 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:57,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 560d9ba15ea34e5d9fe4bfb7933abfe8 2023-02-11 19:03:57,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/rep_barrier/560d9ba15ea34e5d9fe4bfb7933abfe8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 19:03:57,324 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/.tmp/table/2ed4ec05db004016983bd751ae57bb46 as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/table/2ed4ec05db004016983bd751ae57bb46 2023-02-11 19:03:57,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ed4ec05db004016983bd751ae57bb46 2023-02-11 19:03:57,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/table/2ed4ec05db004016983bd751ae57bb46, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 19:03:57,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=21, compaction requested=false 2023-02-11 19:03:57,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 19:03:57,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:03:57,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:57,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142237274Running coprocessor pre-close hooks at 1676142237274Disabling compacts and flushes for region at 1676142237274Disabling writes for close at 1676142237274Obtaining lock to block concurrent updates at 1676142237274Preparing flush snapshotting stores in 1588230740 at 1676142237274Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676142237275 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676142237276 (+1 ms)Flushing 1588230740/info: creating writer at 1676142237276Flushing 1588230740/info: appending metadata at 1676142237278 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676142237278Flushing 1588230740/rep_barrier: creating writer at 1676142237290 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676142237292 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676142237292Flushing 1588230740/table: creating writer at 1676142237303 (+11 ms)Flushing 1588230740/table: appending metadata at 1676142237305 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676142237305Flushing 1588230740/info: reopening flushed file at 1676142237314 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676142237318 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676142237325 (+7 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=21, compaction requested=false at 1676142237331 (+6 ms)Writing region close event to WAL at 1676142237332 (+1 ms)Running coprocessor post-close hooks at 1676142237335 (+3 ms)Closed at 1676142237335 2023-02-11 19:03:57,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:57,467 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:57,467 INFO [RS:1;jenkins-hbase4:43659] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43659,1676142234335; zookeeper connection closed. 2023-02-11 19:03:57,467 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f06cb4f rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,467 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:43659-0x10044c4b4400002, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:57,467 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@171031af rejected from java.util.concurrent.ThreadPoolExecutor@3676609[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,467 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e3e4d1a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e3e4d1a 2023-02-11 19:03:57,474 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34507,1676142234305; all regions closed. 2023-02-11 19:03:57,478 DEBUG [RS:0;jenkins-hbase4:34507] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/oldWALs 2023-02-11 19:03:57,478 INFO [RS:0;jenkins-hbase4:34507] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34507%2C1676142234305.meta:.meta(num 1676142234831) 2023-02-11 19:03:57,484 DEBUG [RS:0;jenkins-hbase4:34507] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/oldWALs 2023-02-11 19:03:57,484 INFO [RS:0;jenkins-hbase4:34507] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34507%2C1676142234305:(num 1676142235225) 2023-02-11 19:03:57,485 DEBUG [RS:0;jenkins-hbase4:34507] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,485 INFO [RS:0;jenkins-hbase4:34507] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:03:57,485 INFO [RS:0;jenkins-hbase4:34507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:03:57,485 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:57,486 INFO [RS:0;jenkins-hbase4:34507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34507 2023-02-11 19:03:57,487 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34507,1676142234305 2023-02-11 19:03:57,487 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:57,487 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c5cb81 rejected from java.util.concurrent.ThreadPoolExecutor@6fa5f01[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,490 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34507,1676142234305] 2023-02-11 19:03:57,490 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34507,1676142234305; numProcessing=2 2023-02-11 19:03:57,492 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34507,1676142234305 already deleted, retry=false 2023-02-11 19:03:57,492 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34507,1676142234305 expired; onlineServers=0 2023-02-11 19:03:57,492 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35651,1676142234259' ***** 2023-02-11 19:03:57,492 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:03:57,493 DEBUG [M:0;jenkins-hbase4:35651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b7733c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:57,493 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35651,1676142234259 2023-02-11 19:03:57,493 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35651,1676142234259; all regions closed. 2023-02-11 19:03:57,493 DEBUG [M:0;jenkins-hbase4:35651] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:03:57,493 DEBUG [M:0;jenkins-hbase4:35651] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:03:57,493 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:03:57,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142234479] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142234479,5,FailOnTimeoutGroup] 2023-02-11 19:03:57,493 DEBUG [M:0;jenkins-hbase4:35651] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:03:57,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142234478] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142234478,5,FailOnTimeoutGroup] 2023-02-11 19:03:57,494 INFO [M:0;jenkins-hbase4:35651] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:03:57,495 INFO [M:0;jenkins-hbase4:35651] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:03:57,495 INFO [M:0;jenkins-hbase4:35651] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:03:57,495 DEBUG [M:0;jenkins-hbase4:35651] master.HMaster(1502): Stopping service threads 2023-02-11 19:03:57,495 INFO [M:0;jenkins-hbase4:35651] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:03:57,496 ERROR [M:0;jenkins-hbase4:35651] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:03:57,496 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:57,496 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:57,496 INFO [M:0;jenkins-hbase4:35651] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:03:57,496 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:03:57,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:57,496 DEBUG [M:0;jenkins-hbase4:35651] zookeeper.ZKUtil(398): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:03:57,496 WARN [M:0;jenkins-hbase4:35651] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:03:57,496 INFO [M:0;jenkins-hbase4:35651] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:03:57,497 INFO [M:0;jenkins-hbase4:35651] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:03:57,497 DEBUG [M:0;jenkins-hbase4:35651] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:57,497 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:57,497 DEBUG [M:0;jenkins-hbase4:35651] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:57,497 DEBUG [M:0;jenkins-hbase4:35651] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:57,497 DEBUG [M:0;jenkins-hbase4:35651] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:57,497 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.08 KB 2023-02-11 19:03:57,507 INFO [M:0;jenkins-hbase4:35651] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f088e21cefa349d68d20d789cfcd3c36 2023-02-11 19:03:57,511 DEBUG [M:0;jenkins-hbase4:35651] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f088e21cefa349d68d20d789cfcd3c36 as hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f088e21cefa349d68d20d789cfcd3c36 2023-02-11 19:03:57,515 INFO [M:0;jenkins-hbase4:35651] regionserver.HStore(1080): Added hdfs://localhost:41507/user/jenkins/test-data/8c1df33c-b78a-6927-93d2-3c00cca48126/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f088e21cefa349d68d20d789cfcd3c36, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 19:03:57,516 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57493, heapSize ~67.06 KB/68672, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-11 19:03:57,516 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:57,516 DEBUG [M:0;jenkins-hbase4:35651] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142237497Disabling compacts and flushes for region at 1676142237497Disabling writes for close at 1676142237497Obtaining lock to block concurrent updates at 1676142237497Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142237497Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57493, getHeapSize=68672, getOffHeapSize=0, getCellsCount=145 at 1676142237497Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142237498 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142237499 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142237501 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142237501Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142237511 (+10 ms)Finished flush of dataSize ~56.15 KB/57493, heapSize ~67.06 KB/68672, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1676142237516 (+5 ms)Writing region close event to WAL at 1676142237516Closed at 1676142237516 2023-02-11 19:03:57,519 INFO [M:0;jenkins-hbase4:35651] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:03:57,519 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:03:57,520 INFO [M:0;jenkins-hbase4:35651] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35651 2023-02-11 19:03:57,522 DEBUG [M:0;jenkins-hbase4:35651] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35651,1676142234259 already deleted, retry=false 2023-02-11 19:03:57,871 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:57,871 INFO [M:0;jenkins-hbase4:35651] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35651,1676142234259; zookeeper connection closed. 2023-02-11 19:03:57,871 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@796de406 rejected from java.util.concurrent.ThreadPoolExecutor@7d527ff3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,872 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): master:35651-0x10044c4b4400000, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:57,872 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f79fbb8 rejected from java.util.concurrent.ThreadPoolExecutor@7d527ff3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,935 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:03:57,971 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:57,971 INFO [RS:0;jenkins-hbase4:34507] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34507,1676142234305; zookeeper connection closed. 2023-02-11 19:03:57,971 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e44c408 rejected from java.util.concurrent.ThreadPoolExecutor@6fa5f01[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,971 DEBUG [Listener at localhost/38283-EventThread] zookeeper.ZKWatcher(600): regionserver:34507-0x10044c4b4400001, quorum=127.0.0.1:61269, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:03:57,971 ERROR [Listener at localhost/38283-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2627de9a rejected from java.util.concurrent.ThreadPoolExecutor@6fa5f01[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:03:57,971 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@ca929ca] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@ca929ca 2023-02-11 19:03:57,972 INFO [Listener at localhost/38283] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:03:57,973 WARN [Listener at localhost/38283] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:57,979 INFO [Listener at localhost/38283] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:58,085 WARN [BP-1246642492-172.31.14.131-1676142233634 heartbeating to localhost/127.0.0.1:41507] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:58,085 WARN [BP-1246642492-172.31.14.131-1676142233634 heartbeating to localhost/127.0.0.1:41507] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1246642492-172.31.14.131-1676142233634 (Datanode Uuid cda07b68-8c8f-471d-b1e8-638332b31078) service to localhost/127.0.0.1:41507 2023-02-11 19:03:58,086 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/dfs/data/data3/current/BP-1246642492-172.31.14.131-1676142233634] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:58,087 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/dfs/data/data4/current/BP-1246642492-172.31.14.131-1676142233634] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:58,088 WARN [Listener at localhost/38283] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:03:58,099 INFO [Listener at localhost/38283] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:58,105 WARN [BP-1246642492-172.31.14.131-1676142233634 heartbeating to localhost/127.0.0.1:41507] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:03:58,105 WARN [BP-1246642492-172.31.14.131-1676142233634 heartbeating to localhost/127.0.0.1:41507] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1246642492-172.31.14.131-1676142233634 (Datanode Uuid a6db88f9-24cd-4451-9879-7d2eb2f9aaf2) service to localhost/127.0.0.1:41507 2023-02-11 19:03:58,106 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/dfs/data/data1/current/BP-1246642492-172.31.14.131-1676142233634] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:58,106 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/cluster_2a0cf80a-21c2-72db-d45e-ddec5bc6fb91/dfs/data/data2/current/BP-1246642492-172.31.14.131-1676142233634] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:03:58,119 INFO [Listener at localhost/38283] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:03:58,237 INFO [Listener at localhost/38283] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:03:58,261 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:03:58,275 INFO [Listener at localhost/38283] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: Listener at localhost/38283.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41507 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41507 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41507 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/38283 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:41507 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:41507 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41507 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41507 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35651,1676142234259)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=656 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 319), ProcessCount=167 (was 167), AvailableMemoryMB=3876 (was 3911) 2023-02-11 19:03:58,290 INFO [Listener at localhost/38283] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=656, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=167, AvailableMemoryMB=3875 2023-02-11 19:03:58,305 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/hadoop.log.dir so I do NOT create it in target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b 2023-02-11 19:03:58,305 WARN [Listener at localhost/38283] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 19:03:58,305 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/hadoop.tmp.dir so I do NOT create it in target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b 2023-02-11 19:03:58,305 WARN [Listener at localhost/38283] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6be256a7-80e2-be55-4797-2743fc252210/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 19:03:58,305 DEBUG [Listener at localhost/38283] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b 2023-02-11 19:03:58,305 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:03:58,305 INFO [Listener at localhost/38283] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3, deleteOnExit=true 2023-02-11 19:03:58,305 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:03:58,306 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/test.cache.data in system properties and HBase conf 2023-02-11 19:03:58,306 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:03:58,306 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:03:58,306 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:03:58,306 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:03:58,306 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:03:58,306 DEBUG [Listener at localhost/38283] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:03:58,307 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:58,307 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:03:58,307 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:03:58,307 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:58,307 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:03:58,307 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:03:58,308 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:03:58,309 INFO [Listener at localhost/38283] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:03:58,313 WARN [Listener at localhost/38283] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:58,314 WARN [Listener at localhost/38283] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:58,355 WARN [Listener at localhost/38283] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:58,357 INFO [Listener at localhost/38283] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:58,364 INFO [Listener at localhost/38283] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/java.io.tmpdir/Jetty_localhost_42577_hdfs____ne5npd/webapp 2023-02-11 19:03:58,476 INFO [Listener at localhost/38283] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42577 2023-02-11 19:03:58,481 WARN [Listener at localhost/38283] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:03:58,481 WARN [Listener at localhost/38283] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:03:58,568 WARN [Listener at localhost/45135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:58,592 WARN [Listener at localhost/45135] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:58,596 WARN [Listener at localhost/45135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:58,597 INFO [Listener at localhost/45135] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:58,604 INFO [Listener at localhost/45135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/java.io.tmpdir/Jetty_localhost_42491_datanode____fvonp1/webapp 2023-02-11 19:03:58,708 INFO [Listener at localhost/45135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42491 2023-02-11 19:03:58,720 WARN [Listener at localhost/39933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:58,742 WARN [Listener at localhost/39933] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:03:58,744 WARN [Listener at localhost/39933] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:03:58,745 INFO [Listener at localhost/39933] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:03:58,755 INFO [Listener at localhost/39933] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/java.io.tmpdir/Jetty_localhost_42685_datanode____.gc1yqs/webapp 2023-02-11 19:03:58,859 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x628f4229f6ca8321: Processing first storage report for DS-d40e1891-df02-481f-b5fa-9662aee901f3 from datanode a1b23c96-13ee-43a8-8cce-cef92fa078b3 2023-02-11 19:03:58,859 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x628f4229f6ca8321: from storage DS-d40e1891-df02-481f-b5fa-9662aee901f3 node DatanodeRegistration(127.0.0.1:39205, datanodeUuid=a1b23c96-13ee-43a8-8cce-cef92fa078b3, infoPort=42865, infoSecurePort=0, ipcPort=39933, storageInfo=lv=-57;cid=testClusterID;nsid=1200107738;c=1676142238316), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:58,859 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x628f4229f6ca8321: Processing first storage report for DS-a841b652-dacb-4265-8010-209454664884 from datanode a1b23c96-13ee-43a8-8cce-cef92fa078b3 2023-02-11 19:03:58,859 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x628f4229f6ca8321: from storage DS-a841b652-dacb-4265-8010-209454664884 node DatanodeRegistration(127.0.0.1:39205, datanodeUuid=a1b23c96-13ee-43a8-8cce-cef92fa078b3, infoPort=42865, infoSecurePort=0, ipcPort=39933, storageInfo=lv=-57;cid=testClusterID;nsid=1200107738;c=1676142238316), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:58,883 INFO [Listener at localhost/39933] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42685 2023-02-11 19:03:58,896 WARN [Listener at localhost/40591] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:03:59,003 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ea937e2fe5b6443: Processing first storage report for DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789 from datanode 0a5ff5bb-5011-4f8a-a96e-e2f0a0f3d571 2023-02-11 19:03:59,003 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ea937e2fe5b6443: from storage DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789 node DatanodeRegistration(127.0.0.1:46697, datanodeUuid=0a5ff5bb-5011-4f8a-a96e-e2f0a0f3d571, infoPort=38673, infoSecurePort=0, ipcPort=40591, storageInfo=lv=-57;cid=testClusterID;nsid=1200107738;c=1676142238316), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:59,003 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ea937e2fe5b6443: Processing first storage report for DS-0f44eef4-0109-4aea-a9db-ac2bf515024c from datanode 0a5ff5bb-5011-4f8a-a96e-e2f0a0f3d571 2023-02-11 19:03:59,003 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ea937e2fe5b6443: from storage DS-0f44eef4-0109-4aea-a9db-ac2bf515024c node DatanodeRegistration(127.0.0.1:46697, datanodeUuid=0a5ff5bb-5011-4f8a-a96e-e2f0a0f3d571, infoPort=38673, infoSecurePort=0, ipcPort=40591, storageInfo=lv=-57;cid=testClusterID;nsid=1200107738;c=1676142238316), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:03:59,007 DEBUG [Listener at localhost/40591] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b 2023-02-11 19:03:59,018 INFO [Listener at localhost/40591] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/zookeeper_0, clientPort=60240, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:03:59,019 INFO [Listener at localhost/40591] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60240 2023-02-11 19:03:59,019 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,020 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,042 INFO [Listener at localhost/40591] util.FSUtils(479): Created version file at hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14 with version=8 2023-02-11 19:03:59,042 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,043 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,044 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45135/user/jenkins/test-data/27c3eae7-c65d-a2e8-6cb5-a905c90e3435/hbase-staging 2023-02-11 19:03:59,046 INFO [Listener at localhost/40591] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:59,046 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,046 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,046 INFO [Listener at localhost/40591] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:59,047 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,047 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:59,047 INFO [Listener at localhost/40591] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:59,048 INFO [Listener at localhost/40591] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41257 2023-02-11 19:03:59,048 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,049 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,050 INFO [Listener at localhost/40591] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41257 connecting to ZooKeeper ensemble=127.0.0.1:60240 2023-02-11 19:03:59,058 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:412570x0, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:59,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41257-0x10044c4c6ee0000 connected 2023-02-11 19:03:59,090 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:59,091 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:59,091 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:59,096 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41257 2023-02-11 19:03:59,097 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41257 2023-02-11 19:03:59,099 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41257 2023-02-11 19:03:59,099 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41257 2023-02-11 19:03:59,100 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41257 2023-02-11 19:03:59,100 INFO [Listener at localhost/40591] master.HMaster(439): hbase.rootdir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14, hbase.cluster.distributed=false 2023-02-11 19:03:59,116 INFO [Listener at localhost/40591] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:59,116 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,116 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,116 INFO [Listener at localhost/40591] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:59,117 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,117 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:59,117 INFO [Listener at localhost/40591] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:59,117 INFO [Listener at localhost/40591] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45223 2023-02-11 19:03:59,118 INFO [Listener at localhost/40591] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:59,118 DEBUG [Listener at localhost/40591] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:59,118 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,119 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,120 INFO [Listener at localhost/40591] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45223 connecting to ZooKeeper ensemble=127.0.0.1:60240 2023-02-11 19:03:59,122 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:452230x0, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:59,123 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): regionserver:452230x0, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:59,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45223-0x10044c4c6ee0001 connected 2023-02-11 19:03:59,124 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:59,136 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:59,137 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45223 2023-02-11 19:03:59,138 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45223 2023-02-11 19:03:59,139 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45223 2023-02-11 19:03:59,139 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45223 2023-02-11 19:03:59,139 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45223 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:03:59,150 INFO [Listener at localhost/40591] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:03:59,151 INFO [Listener at localhost/40591] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40929 2023-02-11 19:03:59,151 INFO [Listener at localhost/40591] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:03:59,153 DEBUG [Listener at localhost/40591] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:03:59,153 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,154 INFO [Listener at localhost/40591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,155 INFO [Listener at localhost/40591] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40929 connecting to ZooKeeper ensemble=127.0.0.1:60240 2023-02-11 19:03:59,157 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:409290x0, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:03:59,158 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): regionserver:409290x0, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:03:59,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40929-0x10044c4c6ee0002 connected 2023-02-11 19:03:59,159 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:03:59,159 DEBUG [Listener at localhost/40591] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:03:59,160 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40929 2023-02-11 19:03:59,160 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40929 2023-02-11 19:03:59,160 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40929 2023-02-11 19:03:59,160 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40929 2023-02-11 19:03:59,161 DEBUG [Listener at localhost/40591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40929 2023-02-11 19:03:59,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,165 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:59,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,168 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:59,168 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:59,168 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:03:59,168 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:59,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41257,1676142239045 from backup master directory 2023-02-11 19:03:59,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:03:59,172 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,172 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:03:59,172 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:59,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/hbase.id with ID: af6a4281-ab80-4a17-a91f-3628a509b34c 2023-02-11 19:03:59,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:03:59,205 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x45b8cf0a to 127.0.0.1:60240 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:59,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fe4950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:59,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:59,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:03:59,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:59,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store-tmp 2023-02-11 19:03:59,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:03:59,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:03:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:59,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:03:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142239225Disabling compacts and flushes for region at 1676142239225Disabling writes for close at 1676142239225Writing region close event to WAL at 1676142239225Closed at 1676142239225 2023-02-11 19:03:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/WALs/jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41257%2C1676142239045, suffix=, logDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/WALs/jenkins-hbase4.apache.org,41257,1676142239045, archiveDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/oldWALs, maxLogs=10 2023-02-11 19:03:59,244 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK] 2023-02-11 19:03:59,244 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK] 2023-02-11 19:03:59,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/WALs/jenkins-hbase4.apache.org,41257,1676142239045/jenkins-hbase4.apache.org%2C41257%2C1676142239045.1676142239227 2023-02-11 19:03:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK], DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK]] 2023-02-11 19:03:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:59,248 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:59,249 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:03:59,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:03:59,250 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:59,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:59,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:03:59,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:59,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59607998, jitterRate=-0.1117716133594513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:03:59,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142239247Initializing all the Stores at 1676142239248 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142239248Cleaning up temporary data from old regions at 1676142239252 (+4 ms)Cleaning up detritus from prior splits at 1676142239252Region opened successfully at 1676142239257 (+5 ms) 2023-02-11 19:03:59,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:03:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:03:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:03:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:03:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 19:03:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 19:03:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:03:59,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:03:59,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:03:59,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:03:59,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:03:59,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:03:59,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:03:59,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:03:59,285 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:03:59,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:03:59,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:03:59,288 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:59,288 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:59,288 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:03:59,288 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41257,1676142239045, sessionid=0x10044c4c6ee0000, setting cluster-up flag (Was=false) 2023-02-11 19:03:59,295 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:03:59,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,304 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:03:59,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:03:59,310 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.hbase-snapshot/.tmp 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:59,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142269318 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:03:59,318 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,318 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:03:59,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:03:59,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:03:59,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:03:59,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:03:59,320 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:59,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:03:59,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142239320,5,FailOnTimeoutGroup] 2023-02-11 19:03:59,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142239320,5,FailOnTimeoutGroup] 2023-02-11 19:03:59,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:03:59,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,328 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:59,328 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:59,328 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14 2023-02-11 19:03:59,340 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:59,341 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:59,342 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/info 2023-02-11 19:03:59,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:59,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:59,344 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:59,344 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:59,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:59,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/table 2023-02-11 19:03:59,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:59,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,347 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740 2023-02-11 19:03:59,347 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740 2023-02-11 19:03:59,349 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:59,352 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:59,354 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:03:59,354 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73297260, jitterRate=0.09221428632736206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:59,354 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142239340Initializing all the Stores at 1676142239340Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142239340Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142239341 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142239341Cleaning up temporary data from old regions at 1676142239348 (+7 ms)Cleaning up detritus from prior splits at 1676142239349 (+1 ms)Region opened successfully at 1676142239354 (+5 ms) 2023-02-11 19:03:59,354 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:03:59,354 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:03:59,354 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:03:59,354 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:03:59,354 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:03:59,355 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:03:59,355 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142239354Disabling compacts and flushes for region at 1676142239354Disabling writes for close at 1676142239354Writing region close event to WAL at 1676142239355 (+1 ms)Closed at 1676142239355 2023-02-11 19:03:59,355 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:03:59,355 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:03:59,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:03:59,357 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:03:59,358 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:03:59,363 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(952): ClusterId : af6a4281-ab80-4a17-a91f-3628a509b34c 2023-02-11 19:03:59,363 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(952): ClusterId : af6a4281-ab80-4a17-a91f-3628a509b34c 2023-02-11 19:03:59,363 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:59,363 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:03:59,366 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:59,366 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:59,367 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:03:59,367 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:03:59,369 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:59,370 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:03:59,370 DEBUG [RS:0;jenkins-hbase4:45223] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddcc517 to 127.0.0.1:60240 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:59,373 DEBUG [RS:1;jenkins-hbase4:40929] zookeeper.ReadOnlyZKClient(139): Connect 0x55a345aa to 127.0.0.1:60240 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:03:59,385 DEBUG [RS:0;jenkins-hbase4:45223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731b24dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:59,385 DEBUG [RS:0;jenkins-hbase4:45223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7724ae67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:59,386 DEBUG [RS:1;jenkins-hbase4:40929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b64a16e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:03:59,386 DEBUG [RS:1;jenkins-hbase4:40929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f5b2eda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:03:59,396 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45223 2023-02-11 19:03:59,396 INFO [RS:0;jenkins-hbase4:45223] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:59,396 INFO [RS:0;jenkins-hbase4:45223] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:59,396 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:59,397 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41257,1676142239045 with isa=jenkins-hbase4.apache.org/172.31.14.131:45223, startcode=1676142239116 2023-02-11 19:03:59,397 DEBUG [RS:0;jenkins-hbase4:45223] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:59,397 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40929 2023-02-11 19:03:59,398 INFO [RS:1;jenkins-hbase4:40929] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:03:59,398 INFO [RS:1;jenkins-hbase4:40929] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:03:59,398 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:03:59,399 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41257,1676142239045 with isa=jenkins-hbase4.apache.org/172.31.14.131:40929, startcode=1676142239149 2023-02-11 19:03:59,399 DEBUG [RS:1;jenkins-hbase4:40929] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:03:59,399 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55741, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:59,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,402 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52427, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:03:59,403 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14 2023-02-11 19:03:59,403 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45135 2023-02-11 19:03:59,403 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:59,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,403 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14 2023-02-11 19:03:59,403 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45135 2023-02-11 19:03:59,403 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:03:59,404 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:03:59,409 DEBUG [RS:0;jenkins-hbase4:45223] zookeeper.ZKUtil(162): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,409 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45223,1676142239116] 2023-02-11 19:03:59,409 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40929,1676142239149] 2023-02-11 19:03:59,409 WARN [RS:0;jenkins-hbase4:45223] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:59,409 INFO [RS:0;jenkins-hbase4:45223] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:59,409 DEBUG [RS:1;jenkins-hbase4:40929] zookeeper.ZKUtil(162): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,409 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,409 WARN [RS:1;jenkins-hbase4:40929] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:03:59,409 INFO [RS:1;jenkins-hbase4:40929] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:59,409 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,414 DEBUG [RS:0;jenkins-hbase4:45223] zookeeper.ZKUtil(162): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,415 DEBUG [RS:1;jenkins-hbase4:40929] zookeeper.ZKUtil(162): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,415 DEBUG [RS:0;jenkins-hbase4:45223] zookeeper.ZKUtil(162): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,415 DEBUG [RS:1;jenkins-hbase4:40929] zookeeper.ZKUtil(162): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,416 DEBUG [RS:0;jenkins-hbase4:45223] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:59,416 INFO [RS:0;jenkins-hbase4:45223] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:59,416 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:03:59,417 INFO [RS:1;jenkins-hbase4:40929] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:03:59,418 INFO [RS:0;jenkins-hbase4:45223] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:59,419 INFO [RS:1;jenkins-hbase4:40929] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:03:59,419 INFO [RS:0;jenkins-hbase4:45223] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:59,419 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,419 INFO [RS:1;jenkins-hbase4:40929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:03:59,419 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,419 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:59,420 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:03:59,421 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,422 DEBUG [RS:1;jenkins-hbase4:40929] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,424 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,424 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,424 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,425 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,425 DEBUG [RS:0;jenkins-hbase4:45223] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:03:59,426 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,426 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,426 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,437 INFO [RS:1;jenkins-hbase4:40929] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:59,437 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40929,1676142239149-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,437 INFO [RS:0;jenkins-hbase4:45223] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:03:59,437 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45223,1676142239116-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,450 INFO [RS:0;jenkins-hbase4:45223] regionserver.Replication(203): jenkins-hbase4.apache.org,45223,1676142239116 started 2023-02-11 19:03:59,450 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45223,1676142239116, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45223, sessionid=0x10044c4c6ee0001 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45223,1676142239116' 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45223,1676142239116' 2023-02-11 19:03:59,450 DEBUG [RS:0;jenkins-hbase4:45223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:59,451 DEBUG [RS:0;jenkins-hbase4:45223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:59,451 DEBUG [RS:0;jenkins-hbase4:45223] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:59,451 INFO [RS:0;jenkins-hbase4:45223] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:59,451 INFO [RS:0;jenkins-hbase4:45223] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:59,453 INFO [RS:1;jenkins-hbase4:40929] regionserver.Replication(203): jenkins-hbase4.apache.org,40929,1676142239149 started 2023-02-11 19:03:59,453 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40929,1676142239149, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40929, sessionid=0x10044c4c6ee0002 2023-02-11 19:03:59,453 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:03:59,453 DEBUG [RS:1;jenkins-hbase4:40929] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,453 DEBUG [RS:1;jenkins-hbase4:40929] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40929,1676142239149' 2023-02-11 19:03:59,453 DEBUG [RS:1;jenkins-hbase4:40929] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:03:59,453 DEBUG [RS:1;jenkins-hbase4:40929] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40929,1676142239149' 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:03:59,454 DEBUG [RS:1;jenkins-hbase4:40929] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:03:59,454 INFO [RS:1;jenkins-hbase4:40929] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:03:59,454 INFO [RS:1;jenkins-hbase4:40929] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:03:59,509 DEBUG [jenkins-hbase4:41257] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:03:59,509 DEBUG [jenkins-hbase4:41257] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:59,510 DEBUG [jenkins-hbase4:41257] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:59,510 DEBUG [jenkins-hbase4:41257] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:59,510 DEBUG [jenkins-hbase4:41257] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:59,511 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40929,1676142239149, state=OPENING 2023-02-11 19:03:59,513 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:03:59,514 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:03:59,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40929,1676142239149}] 2023-02-11 19:03:59,516 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:59,671 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,671 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:03:59,673 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59184, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:03:59,680 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:03:59,680 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:03:59,681 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40929%2C1676142239149.meta, suffix=.meta, logDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,40929,1676142239149, archiveDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/oldWALs, maxLogs=32 2023-02-11 19:03:59,698 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK] 2023-02-11 19:03:59,698 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK] 2023-02-11 19:03:59,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,40929,1676142239149/jenkins-hbase4.apache.org%2C40929%2C1676142239149.meta.1676142239681.meta 2023-02-11 19:03:59,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK], DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK]] 2023-02-11 19:03:59,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:03:59,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:03:59,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:03:59,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:03:59,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:03:59,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:59,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:03:59,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:03:59,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:03:59,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/info 2023-02-11 19:03:59,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/info 2023-02-11 19:03:59,703 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:03:59,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:03:59,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:59,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:03:59,705 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:03:59,706 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,706 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:03:59,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/table 2023-02-11 19:03:59,707 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/table 2023-02-11 19:03:59,707 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:03:59,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:03:59,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740 2023-02-11 19:03:59,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740 2023-02-11 19:03:59,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:03:59,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:03:59,712 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62936779, jitterRate=-0.0621689110994339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:03:59,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142239701Writing region info on filesystem at 1676142239701Initializing all the Stores at 1676142239702 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142239702Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142239702Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142239702Cleaning up temporary data from old regions at 1676142239710 (+8 ms)Cleaning up detritus from prior splits at 1676142239710Running coprocessor post-open hooks at 1676142239712 (+2 ms)Region opened successfully at 1676142239712 2023-02-11 19:03:59,713 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142239671 2023-02-11 19:03:59,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:03:59,718 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40929,1676142239149, state=OPEN 2023-02-11 19:03:59,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:03:59,728 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:03:59,728 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:03:59,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:03:59,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40929,1676142239149 in 212 msec 2023-02-11 19:03:59,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:03:59,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 374 msec 2023-02-11 19:03:59,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 421 msec 2023-02-11 19:03:59,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142239166, completionTime=-1 2023-02-11 19:03:59,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:03:59,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:03:59,735 DEBUG [hconnection-0x5e4d40d1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:03:59,736 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59188, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:03:59,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:03:59,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142299738 2023-02-11 19:03:59,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142359738 2023-02-11 19:03:59,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41257,1676142239045-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41257,1676142239045-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41257,1676142239045-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41257, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:03:59,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:03:59,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:03:59,753 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:03:59,754 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:03:59,754 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:03:59,756 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:03:59,756 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234 empty. 2023-02-11 19:03:59,756 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:03:59,756 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:03:59,765 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:03:59,766 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4ad656cd9e0c52e96190aae30cb99234, NAME => 'hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp 2023-02-11 19:03:59,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:03:59,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4ad656cd9e0c52e96190aae30cb99234, disabling compactions & flushes 2023-02-11 19:03:59,772 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:03:59,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:03:59,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. after waiting 0 ms 2023-02-11 19:03:59,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:03:59,772 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:03:59,772 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4ad656cd9e0c52e96190aae30cb99234: Waiting for close lock at 1676142239772Disabling compacts and flushes for region at 1676142239772Disabling writes for close at 1676142239772Writing region close event to WAL at 1676142239772Closed at 1676142239772 2023-02-11 19:03:59,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:03:59,775 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142239775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142239775"}]},"ts":"1676142239775"} 2023-02-11 19:03:59,776 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:03:59,777 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:03:59,777 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142239777"}]},"ts":"1676142239777"} 2023-02-11 19:03:59,779 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:03:59,781 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:03:59,782 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:03:59,782 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:03:59,782 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:03:59,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4ad656cd9e0c52e96190aae30cb99234, ASSIGN}] 2023-02-11 19:03:59,785 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4ad656cd9e0c52e96190aae30cb99234, ASSIGN 2023-02-11 19:03:59,786 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4ad656cd9e0c52e96190aae30cb99234, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40929,1676142239149; forceNewPlan=false, retain=false 2023-02-11 19:03:59,936 INFO [jenkins-hbase4:41257] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:03:59,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4ad656cd9e0c52e96190aae30cb99234, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:03:59,937 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142239936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142239936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142239936"}]},"ts":"1676142239936"} 2023-02-11 19:03:59,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4ad656cd9e0c52e96190aae30cb99234, server=jenkins-hbase4.apache.org,40929,1676142239149}] 2023-02-11 19:04:00,092 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:00,094 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40929%2C1676142239149, suffix=, logDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,40929,1676142239149, archiveDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/oldWALs, maxLogs=32 2023-02-11 19:04:00,109 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK] 2023-02-11 19:04:00,109 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK] 2023-02-11 19:04:00,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,40929,1676142239149/jenkins-hbase4.apache.org%2C40929%2C1676142239149.1676142240094 2023-02-11 19:04:00,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK], DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK]] 2023-02-11 19:04:00,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4ad656cd9e0c52e96190aae30cb99234, NAME => 'hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:04:00,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:00,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,116 INFO [StoreOpener-4ad656cd9e0c52e96190aae30cb99234-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,117 DEBUG [StoreOpener-4ad656cd9e0c52e96190aae30cb99234-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/info 2023-02-11 19:04:00,117 DEBUG [StoreOpener-4ad656cd9e0c52e96190aae30cb99234-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/info 2023-02-11 19:04:00,118 INFO [StoreOpener-4ad656cd9e0c52e96190aae30cb99234-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ad656cd9e0c52e96190aae30cb99234 columnFamilyName info 2023-02-11 19:04:00,118 INFO [StoreOpener-4ad656cd9e0c52e96190aae30cb99234-1] regionserver.HStore(310): Store=4ad656cd9e0c52e96190aae30cb99234/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:00,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:00,123 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:04:00,124 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4ad656cd9e0c52e96190aae30cb99234; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68980566, jitterRate=0.027890533208847046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:04:00,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4ad656cd9e0c52e96190aae30cb99234: Running coprocessor pre-open hook at 1676142240115Writing region info on filesystem at 1676142240115Initializing all the Stores at 1676142240116 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142240116Cleaning up temporary data from old regions at 1676142240120 (+4 ms)Cleaning up detritus from prior splits at 1676142240120Running coprocessor post-open hooks at 1676142240124 (+4 ms)Region opened successfully at 1676142240124 2023-02-11 19:04:00,125 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234., pid=6, masterSystemTime=1676142240089 2023-02-11 19:04:00,127 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:00,127 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:00,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4ad656cd9e0c52e96190aae30cb99234, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:00,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142240127"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142240127"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142240127"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142240127"}]},"ts":"1676142240127"} 2023-02-11 19:04:00,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:04:00,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4ad656cd9e0c52e96190aae30cb99234, server=jenkins-hbase4.apache.org,40929,1676142239149 in 190 msec 2023-02-11 19:04:00,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:04:00,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4ad656cd9e0c52e96190aae30cb99234, ASSIGN in 348 msec 2023-02-11 19:04:00,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:04:00,132 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142240132"}]},"ts":"1676142240132"} 2023-02-11 19:04:00,133 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:04:00,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:04:00,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-11 19:04:00,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:04:00,154 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:04:00,154 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:00,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:04:00,164 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:04:00,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 19:04:00,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:04:00,175 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:04:00,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-11 19:04:00,182 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:04:00,186 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:04:00,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.014sec 2023-02-11 19:04:00,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:04:00,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:04:00,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:04:00,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41257,1676142239045-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:04:00,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41257,1676142239045-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:04:00,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:04:00,263 DEBUG [Listener at localhost/40591] zookeeper.ReadOnlyZKClient(139): Connect 0x66e0a22b to 127.0.0.1:60240 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:00,267 DEBUG [Listener at localhost/40591] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ba4d294, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:00,268 DEBUG [hconnection-0x7bc17a37-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:04:00,270 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59194, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:04:00,272 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:04:00,272 DEBUG [Listener at localhost/40591] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:04:00,275 DEBUG [Listener at localhost/40591] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:04:00,277 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:04:00,277 INFO [Listener at localhost/40591] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:00,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:00,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:04:00,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:59538 deadline: 1676142300278, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:00,279 INFO [Listener at localhost/40591] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 19:04:00,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:04:00,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:00,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:04:00,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-11 19:04:00,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:04:00,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:00,286 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,286 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 empty. 2023-02-11 19:04:00,286 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,287 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-11 19:04:00,299 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-11 19:04:00,300 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf8a09b85b3f04557fc1f745669faed2, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp 2023-02-11 19:04:00,306 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:00,306 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing cf8a09b85b3f04557fc1f745669faed2, disabling compactions & flushes 2023-02-11 19:04:00,306 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,306 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,306 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. after waiting 0 ms 2023-02-11 19:04:00,306 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,306 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,306 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for cf8a09b85b3f04557fc1f745669faed2: Waiting for close lock at 1676142240306Disabling compacts and flushes for region at 1676142240306Disabling writes for close at 1676142240306Writing region close event to WAL at 1676142240306Closed at 1676142240306 2023-02-11 19:04:00,308 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:04:00,309 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676142240308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142240308"}]},"ts":"1676142240308"} 2023-02-11 19:04:00,310 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:04:00,311 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:04:00,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142240311"}]},"ts":"1676142240311"} 2023-02-11 19:04:00,312 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-11 19:04:00,315 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:04:00,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:04:00,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:04:00,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:04:00,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, ASSIGN}] 2023-02-11 19:04:00,318 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, ASSIGN 2023-02-11 19:04:00,319 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45223,1676142239116; forceNewPlan=false, retain=false 2023-02-11 19:04:00,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:00,452 INFO [RS:0;jenkins-hbase4:45223] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45223%2C1676142239116, suffix=, logDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,45223,1676142239116, archiveDir=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/oldWALs, maxLogs=32 2023-02-11 19:04:00,467 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK] 2023-02-11 19:04:00,467 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK] 2023-02-11 19:04:00,469 INFO [RS:0;jenkins-hbase4:45223] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,45223,1676142239116/jenkins-hbase4.apache.org%2C45223%2C1676142239116.1676142240453 2023-02-11 19:04:00,469 INFO [jenkins-hbase4:41257] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:04:00,469 DEBUG [RS:0;jenkins-hbase4:45223] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46697,DS-25f57ce8-cc20-4c47-9592-05bf8fb1c789,DISK], DatanodeInfoWithStorage[127.0.0.1:39205,DS-d40e1891-df02-481f-b5fa-9662aee901f3,DISK]] 2023-02-11 19:04:00,469 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cf8a09b85b3f04557fc1f745669faed2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:00,470 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676142240469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142240469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142240469"}]},"ts":"1676142240469"} 2023-02-11 19:04:00,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure cf8a09b85b3f04557fc1f745669faed2, server=jenkins-hbase4.apache.org,45223,1676142239116}] 2023-02-11 19:04:00,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:00,624 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:00,624 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:04:00,625 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47920, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:04:00,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf8a09b85b3f04557fc1f745669faed2, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:04:00,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:00,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,629 INFO [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,631 DEBUG [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1 2023-02-11 19:04:00,631 DEBUG [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1 2023-02-11 19:04:00,631 INFO [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf8a09b85b3f04557fc1f745669faed2 columnFamilyName f1 2023-02-11 19:04:00,631 INFO [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] regionserver.HStore(310): Store=cf8a09b85b3f04557fc1f745669faed2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:00,631 INFO [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,632 DEBUG [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2 2023-02-11 19:04:00,632 DEBUG [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2 2023-02-11 19:04:00,633 INFO [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf8a09b85b3f04557fc1f745669faed2 columnFamilyName f2 2023-02-11 19:04:00,633 INFO [StoreOpener-cf8a09b85b3f04557fc1f745669faed2-1] regionserver.HStore(310): Store=cf8a09b85b3f04557fc1f745669faed2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:00,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:04:00,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:00,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:04:00,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cf8a09b85b3f04557fc1f745669faed2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74836487, jitterRate=0.1151505559682846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:04:00,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cf8a09b85b3f04557fc1f745669faed2: Running coprocessor pre-open hook at 1676142240628Writing region info on filesystem at 1676142240628Initializing all the Stores at 1676142240629 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142240629Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142240629Cleaning up temporary data from old regions at 1676142240634 (+5 ms)Cleaning up detritus from prior splits at 1676142240635 (+1 ms)Running coprocessor post-open hooks at 1676142240639 (+4 ms)Region opened successfully at 1676142240639 2023-02-11 19:04:00,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2., pid=12, masterSystemTime=1676142240623 2023-02-11 19:04:00,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:00,644 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cf8a09b85b3f04557fc1f745669faed2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:00,644 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676142240644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142240644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142240644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142240644"}]},"ts":"1676142240644"} 2023-02-11 19:04:00,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 19:04:00,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure cf8a09b85b3f04557fc1f745669faed2, server=jenkins-hbase4.apache.org,45223,1676142239116 in 174 msec 2023-02-11 19:04:00,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 19:04:00,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, ASSIGN in 329 msec 2023-02-11 19:04:00,648 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:04:00,648 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142240648"}]},"ts":"1676142240648"} 2023-02-11 19:04:00,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-11 19:04:00,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:04:00,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 376 msec 2023-02-11 19:04:00,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:00,889 INFO [Listener at localhost/40591] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-11 19:04:00,889 DEBUG [Listener at localhost/40591] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-11 19:04:00,889 INFO [Listener at localhost/40591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:04:00,891 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-11 19:04:00,891 INFO [Listener at localhost/40591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:04:00,891 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-11 19:04:00,891 INFO [Listener at localhost/40591] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:04:00,904 DEBUG [hconnection-0x7bc17a37-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:04:00,916 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:04:00,923 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,004 INFO [Listener at localhost/40591] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:04:01,004 INFO [Listener at localhost/40591] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:04:01,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 19:04:01,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142241005 (current time:1676142241005). 2023-02-11 19:04:01,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:04:01,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] zookeeper.ReadOnlyZKClient(139): Connect 0x789cb722 to 127.0.0.1:60240 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:01,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@186b0ec4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:01,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:04:01,010 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59200, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:04:01,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x789cb722 to 127.0.0.1:60240 2023-02-11 19:04:01,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:01,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:04:01,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 19:04:01,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 19:04:01,015 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 19:04:01,015 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676142841015 2023-02-11 19:04:01,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 19:04:01,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,017 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:04:01,018 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 19:04:01,018 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:04:01,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 19:04:01,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-11 19:04:01,019 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 19:04:01,020 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676142841020 2023-02-11 19:04:01,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-11 19:04:01,027 INFO [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-11 19:04:01,027 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:04:01,028 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-11 19:04:01,028 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-11 19:04:01,028 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,028 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,029 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:01,029 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:01,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:01,029 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:01,030 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,030 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-11 19:04:01,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-11 19:04:01,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 19:04:01,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 19:04:01,031 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 19:04:01,031 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40929,1676142239149' joining acquired barrier for procedure (foo) in zk 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 19:04:01,032 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45223,1676142239116' joining acquired barrier for procedure (foo) in zk 2023-02-11 19:04:01,039 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,040 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,040 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:01,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:04:01,040 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,040 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:01,040 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,040 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:01,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:01,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:01,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:04:01,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:01,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45223,1676142239116' joining acquired barrier for procedure 'foo' on coordinator 2023-02-11 19:04:01,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a842eca[Count = 0] remaining members to acquire global barrier 2023-02-11 19:04:01,042 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-11 19:04:01,042 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,043 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 19:04:01,043 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 19:04:01,043 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 19:04:01,043 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,043 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 19:04:01,043 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:04:01,043 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,043 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:04:01,043 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40929,1676142239149' in zk 2023-02-11 19:04:01,043 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. started... 2023-02-11 19:04:01,043 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cf8a09b85b3f04557fc1f745669faed2 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 19:04:01,045 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 19:04:01,045 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:01,045 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 19:04:01,058 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f1/fc73140a5ffe47e98a422ba435175edc 2023-02-11 19:04:01,079 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f2/ee015858472049179a2f55269a1e8b66 2023-02-11 19:04:01,083 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f1/fc73140a5ffe47e98a422ba435175edc as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc 2023-02-11 19:04:01,087 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:04:01,087 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f2/ee015858472049179a2f55269a1e8b66 as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66 2023-02-11 19:04:01,091 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:04:01,092 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for cf8a09b85b3f04557fc1f745669faed2 in 49ms, sequenceid=5, compaction requested=false 2023-02-11 19:04:01,092 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cf8a09b85b3f04557fc1f745669faed2: 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.' region-info for snapshot=foo 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc] hfiles 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc for snapshot=foo 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66] hfiles 2023-02-11 19:04:01,093 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66 for snapshot=foo 2023-02-11 19:04:01,100 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. completed. 2023-02-11 19:04:01,100 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,100 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 19:04:01,100 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 19:04:01,100 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,100 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 19:04:01,100 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45223,1676142239116' in zk 2023-02-11 19:04:01,103 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,103 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 19:04:01,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:01,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:04:01,103 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:01,103 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 19:04:01,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:01,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:01,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:04:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:04:01,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45223,1676142239116': 2023-02-11 19:04:01,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45223,1676142239116' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-11 19:04:01,106 INFO [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-11 19:04:01,106 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:04:01,106 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:04:01,106 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-11 19:04:01,106 INFO [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:04:01,108 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:04:01,108 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:01,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,108 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,109 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:01,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:01,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:01,109 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:04:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:04:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,110 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,111 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 19:04:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:01,116 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-11 19:04:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:01,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-11 19:04:01,116 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,117 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 19:04:01,117 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:01,117 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,117 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,117 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 19:04:01,117 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 19:04:01,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.hbase-snapshot/.tmp/foo 2023-02-11 19:04:01,118 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:04:01,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-11 19:04:01,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:04:01,119 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:04:01,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.hbase-snapshot/.tmp/foo to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.hbase-snapshot/foo 2023-02-11 19:04:01,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-11 19:04:01,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.hbase-snapshot/.tmp/foo 2023-02-11 19:04:01,154 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.hbase-snapshot/.tmp/foo 2023-02-11 19:04:01,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676142241016Consolidate snapshot: foo at 1676142241116 (+100 ms)Loading Region manifests for foo at 1676142241117 (+1 ms)Writing data manifest for foo at 1676142241120 (+3 ms)Verifying snapshot: foo at 1676142241132 (+12 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676142241154 (+22 ms) 2023-02-11 19:04:01,157 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 19:04:01,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 140 msec 2023-02-11 19:04:01,319 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:04:01,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-11 19:04:01,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:04:01,321 INFO [Listener at localhost/40591] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:04:01,325 INFO [Listener at localhost/40591] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:04:01,329 INFO [Listener at localhost/40591] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:04:01,358 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45223] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,444 INFO [Listener at localhost/40591] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:04:01,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:04:01,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,451 INFO [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 19:04:01,451 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:04:01,452 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-11 19:04:01,452 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-11 19:04:01,453 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,453 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,455 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:01,455 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:01,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:01,455 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:01,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:01,456 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,456 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:04:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,457 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-11 19:04:01,457 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:04:01,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,458 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-11 19:04:01,458 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-11 19:04:01,458 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40929,1676142239149' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-11 19:04:01,458 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-11 19:04:01,458 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:04:01,459 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-11 19:04:01,459 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:04:01,459 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,459 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:04:01,459 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. started... 2023-02-11 19:04:01,459 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf8a09b85b3f04557fc1f745669faed2 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 19:04:01,460 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,461 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,461 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:01,474 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f1/11381cf2a76a45f491e02f5fb30f4de8 2023-02-11 19:04:01,499 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f2/8c09cebd05334f9da78fd10603a0f1a3 2023-02-11 19:04:01,503 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f1/11381cf2a76a45f491e02f5fb30f4de8 as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/11381cf2a76a45f491e02f5fb30f4de8 2023-02-11 19:04:01,507 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/11381cf2a76a45f491e02f5fb30f4de8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:04:01,508 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/.tmp/f2/8c09cebd05334f9da78fd10603a0f1a3 as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/8c09cebd05334f9da78fd10603a0f1a3 2023-02-11 19:04:01,511 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/8c09cebd05334f9da78fd10603a0f1a3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:04:01,512 INFO [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for cf8a09b85b3f04557fc1f745669faed2 in 53ms, sequenceid=9, compaction requested=false 2023-02-11 19:04:01,513 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf8a09b85b3f04557fc1f745669faed2: 2023-02-11 19:04:01,513 DEBUG [rs(jenkins-hbase4.apache.org,45223,1676142239116)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:04:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:04:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-11 19:04:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45223,1676142239116' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-11 19:04:01,515 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,515 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:04:01,515 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,515 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:01,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45223,1676142239116' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-11 19:04:01,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ebbb542[Count = 0] remaining members to acquire global barrier 2023-02-11 19:04:01,517 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-11 19:04:01,517 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,518 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,518 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-11 19:04:01,518 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-11 19:04:01,518 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:04:01,518 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-11 19:04:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-11 19:04:01,518 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,40929,1676142239149' in zk 2023-02-11 19:04:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45223,1676142239116' in zk 2023-02-11 19:04:01,521 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-11 19:04:01,521 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-11 19:04:01,521 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:01,521 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,521 DEBUG [member: 'jenkins-hbase4.apache.org,45223,1676142239116' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-11 19:04:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:04:01,521 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:01,522 DEBUG [member: 'jenkins-hbase4.apache.org,40929,1676142239149' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-11 19:04:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,45223,1676142239116': 2023-02-11 19:04:01,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45223,1676142239116' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-11 19:04:01,524 INFO [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-11 19:04:01,524 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:04:01,524 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:04:01,524 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,524 INFO [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:04:01,526 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:04:01,526 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:01,526 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:01,527 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,527 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:01,529 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,529 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:01,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 19:04:01,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:04:01,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:01,531 DEBUG [(jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:01,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:01,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-11 19:04:01,531 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:01,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:04:01,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,532 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,632 DEBUG [Listener at localhost/40591] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:04:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:04:01,637 INFO [Listener at localhost/40591] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676142241005 type: FLUSH version: 2 ttl: 0 2023-02-11 19:04:01,637 DEBUG [Listener at localhost/40591] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45135/user/jenkins/test-data/27c3eae7-c65d-a2e8-6cb5-a905c90e3435/foo/124bb0a3-4c86-43e4-97b5-b5a83d6d934e/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,638 INFO [Listener at localhost/40591] snapshot.RestoreSnapshotHelper(239): region to add: cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:01,638 INFO [Listener at localhost/40591] snapshot.RestoreSnapshotHelper(585): clone region=cf8a09b85b3f04557fc1f745669faed2 as cf8a09b85b3f04557fc1f745669faed2 in snapshot foo 2023-02-11 19:04:01,638 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf8a09b85b3f04557fc1f745669faed2, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45135/user/jenkins/test-data/27c3eae7-c65d-a2e8-6cb5-a905c90e3435/foo/124bb0a3-4c86-43e4-97b5-b5a83d6d934e 2023-02-11 19:04:01,644 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:01,644 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fc73140a5ffe47e98a422ba435175edc from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,646 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee015858472049179a2f55269a1e8b66 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cf8a09b85b3f04557fc1f745669faed2, disabling compactions & flushes 2023-02-11 19:04:01,648 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. after waiting 0 ms 2023-02-11 19:04:01,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,648 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,648 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cf8a09b85b3f04557fc1f745669faed2: Waiting for close lock at 1676142241648Disabling compacts and flushes for region at 1676142241648Disabling writes for close at 1676142241648Writing region close event to WAL at 1676142241648Closed at 1676142241648 2023-02-11 19:04:01,650 INFO [Listener at localhost/40591] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676142241005 type: FLUSH version: 2 ttl: 0 2023-02-11 19:04:01,650 DEBUG [Listener at localhost/40591] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45135/user/jenkins/test-data/27c3eae7-c65d-a2e8-6cb5-a905c90e3435/foo/124bb0a3-4c86-43e4-97b5-b5a83d6d934e 2023-02-11 19:04:01,650 DEBUG [Listener at localhost/40591] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45135/user/jenkins/test-data/27c3eae7-c65d-a2e8-6cb5-a905c90e3435/foo/124bb0a3-4c86-43e4-97b5-b5a83d6d934e 2023-02-11 19:04:01,650 DEBUG [Listener at localhost/40591] util.CommonFSUtils(699): |-data/ 2023-02-11 19:04:01,651 DEBUG [Listener at localhost/40591] util.CommonFSUtils(699): |----default/ 2023-02-11 19:04:01,651 DEBUG [Listener at localhost/40591] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-11 19:04:01,651 DEBUG [Listener at localhost/40591] util.CommonFSUtils(699): |----------cf8a09b85b3f04557fc1f745669faed2/ 2023-02-11 19:04:01,651 DEBUG [Listener at localhost/40591] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:04:01,651 DEBUG [Listener at localhost/40591] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:04:01,652 DEBUG [Listener at localhost/40591] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=cf8a09b85b3f04557fc1f745669faed2-fc73140a5ffe47e98a422ba435175edc 2023-02-11 19:04:01,652 DEBUG [Listener at localhost/40591] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:04:01,652 DEBUG [Listener at localhost/40591] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=cf8a09b85b3f04557fc1f745669faed2-ee015858472049179a2f55269a1e8b66 hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/11381cf2a76a45f491e02f5fb30f4de8 hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/8c09cebd05334f9da78fd10603a0f1a3 hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66 2023-02-11 19:04:01,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-11 19:04:01,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-11 19:04:01,660 INFO [Listener at localhost/40591] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:04:01,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142241664"}]},"ts":"1676142241664"} 2023-02-11 19:04:01,665 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-11 19:04:01,666 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-11 19:04:01,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, UNASSIGN}] 2023-02-11 19:04:01,668 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, UNASSIGN 2023-02-11 19:04:01,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf8a09b85b3f04557fc1f745669faed2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:01,669 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676142241669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142241669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142241669"}]},"ts":"1676142241669"} 2023-02-11 19:04:01,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure cf8a09b85b3f04557fc1f745669faed2, server=jenkins-hbase4.apache.org,45223,1676142239116}] 2023-02-11 19:04:01,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:04:01,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:01,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cf8a09b85b3f04557fc1f745669faed2, disabling compactions & flushes 2023-02-11 19:04:01,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. after waiting 0 ms 2023-02-11 19:04:01,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:04:01,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2. 2023-02-11 19:04:01,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cf8a09b85b3f04557fc1f745669faed2: Waiting for close lock at 1676142241822Running coprocessor pre-close hooks at 1676142241822Disabling compacts and flushes for region at 1676142241822Disabling writes for close at 1676142241822Writing region close event to WAL at 1676142241823 (+1 ms)Running coprocessor post-close hooks at 1676142241827 (+4 ms)Closed at 1676142241827 2023-02-11 19:04:01,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:01,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf8a09b85b3f04557fc1f745669faed2, regionState=CLOSED 2023-02-11 19:04:01,829 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676142241828"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142241828"}]},"ts":"1676142241828"} 2023-02-11 19:04:01,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 19:04:01,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure cf8a09b85b3f04557fc1f745669faed2, server=jenkins-hbase4.apache.org,45223,1676142239116 in 160 msec 2023-02-11 19:04:01,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 19:04:01,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cf8a09b85b3f04557fc1f745669faed2, UNASSIGN in 164 msec 2023-02-11 19:04:01,832 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142241832"}]},"ts":"1676142241832"} 2023-02-11 19:04:01,833 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-11 19:04:01,836 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-11 19:04:01,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 175 msec 2023-02-11 19:04:01,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:04:01,967 INFO [Listener at localhost/40591] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-11 19:04:01,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,971 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,971 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:04:01,974 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:01,976 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1, FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2, FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/recovered.edits] 2023-02-11 19:04:01,979 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/11381cf2a76a45f491e02f5fb30f4de8 to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/11381cf2a76a45f491e02f5fb30f4de8 2023-02-11 19:04:01,980 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f1/fc73140a5ffe47e98a422ba435175edc 2023-02-11 19:04:01,982 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/8c09cebd05334f9da78fd10603a0f1a3 to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/8c09cebd05334f9da78fd10603a0f1a3 2023-02-11 19:04:01,984 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66 to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/f2/ee015858472049179a2f55269a1e8b66 2023-02-11 19:04:01,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/recovered.edits/12.seqid to hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2/recovered.edits/12.seqid 2023-02-11 19:04:01,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cf8a09b85b3f04557fc1f745669faed2 2023-02-11 19:04:01,986 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-11 19:04:01,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,990 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-11 19:04:01,991 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-11 19:04:01,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:01,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-11 19:04:01,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142241995"}]},"ts":"9223372036854775807"} 2023-02-11 19:04:01,996 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 19:04:01,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cf8a09b85b3f04557fc1f745669faed2, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676142240281.cf8a09b85b3f04557fc1f745669faed2.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 19:04:01,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-11 19:04:01,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676142241996"}]},"ts":"9223372036854775807"} 2023-02-11 19:04:01,997 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-11 19:04:01,999 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 19:04:02,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 31 msec 2023-02-11 19:04:02,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41257] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:04:02,073 INFO [Listener at localhost/40591] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-11 19:04:02,073 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:04:02,073 INFO [Listener at localhost/40591] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:04:02,073 DEBUG [Listener at localhost/40591] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66e0a22b to 127.0.0.1:60240 2023-02-11 19:04:02,074 DEBUG [Listener at localhost/40591] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,074 DEBUG [Listener at localhost/40591] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:04:02,074 DEBUG [Listener at localhost/40591] util.JVMClusterUtil(257): Found active master hash=691069655, stopped=false 2023-02-11 19:04:02,074 INFO [Listener at localhost/40591] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:04:02,077 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:02,078 INFO [Listener at localhost/40591] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:04:02,077 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:02,077 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:02,079 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:02,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:02,079 DEBUG [Listener at localhost/40591] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45b8cf0a to 127.0.0.1:60240 2023-02-11 19:04:02,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:02,080 DEBUG [Listener at localhost/40591] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:02,080 INFO [Listener at localhost/40591] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45223,1676142239116' ***** 2023-02-11 19:04:02,080 INFO [Listener at localhost/40591] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:04:02,080 INFO [Listener at localhost/40591] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40929,1676142239149' ***** 2023-02-11 19:04:02,080 INFO [Listener at localhost/40591] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:04:02,080 INFO [RS:0;jenkins-hbase4:45223] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:04:02,080 INFO [RS:1;jenkins-hbase4:40929] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:04:02,080 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:04:02,080 INFO [RS:1;jenkins-hbase4:40929] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:04:02,080 INFO [RS:0;jenkins-hbase4:45223] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:04:02,082 INFO [RS:0;jenkins-hbase4:45223] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:04:02,081 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:04:02,082 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:02,082 INFO [RS:1;jenkins-hbase4:40929] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:04:02,082 DEBUG [RS:0;jenkins-hbase4:45223] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddcc517 to 127.0.0.1:60240 2023-02-11 19:04:02,083 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(3304): Received CLOSE for 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:02,083 DEBUG [RS:0;jenkins-hbase4:45223] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,083 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45223,1676142239116; all regions closed. 2023-02-11 19:04:02,083 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:02,083 DEBUG [RS:1;jenkins-hbase4:40929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55a345aa to 127.0.0.1:60240 2023-02-11 19:04:02,083 DEBUG [RS:1;jenkins-hbase4:40929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4ad656cd9e0c52e96190aae30cb99234, disabling compactions & flushes 2023-02-11 19:04:02,083 INFO [RS:1;jenkins-hbase4:40929] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:04:02,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:02,083 INFO [RS:1;jenkins-hbase4:40929] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:04:02,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:02,083 INFO [RS:1;jenkins-hbase4:40929] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:04:02,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. after waiting 0 ms 2023-02-11 19:04:02,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:02,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4ad656cd9e0c52e96190aae30cb99234 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:04:02,083 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:04:02,084 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 19:04:02,084 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 4ad656cd9e0c52e96190aae30cb99234=hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234.} 2023-02-11 19:04:02,084 DEBUG [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1505): Waiting on 1588230740, 4ad656cd9e0c52e96190aae30cb99234 2023-02-11 19:04:02,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:04:02,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:04:02,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:04:02,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:04:02,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:04:02,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-11 19:04:02,085 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/WALs/jenkins-hbase4.apache.org,45223,1676142239116/jenkins-hbase4.apache.org%2C45223%2C1676142239116.1676142240453 not finished, retry = 0 2023-02-11 19:04:02,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/.tmp/info/9f1ad3e5158e45c79f188fb668772faf 2023-02-11 19:04:02,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/.tmp/info/dbd7b92ad782427c94dfb9154766f50a 2023-02-11 19:04:02,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f1ad3e5158e45c79f188fb668772faf 2023-02-11 19:04:02,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/.tmp/info/dbd7b92ad782427c94dfb9154766f50a as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/info/dbd7b92ad782427c94dfb9154766f50a 2023-02-11 19:04:02,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/info/dbd7b92ad782427c94dfb9154766f50a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:04:02,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4ad656cd9e0c52e96190aae30cb99234 in 23ms, sequenceid=6, compaction requested=false 2023-02-11 19:04:02,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/.tmp/rep_barrier/899ffccbf00f412ab17267698a274a3e 2023-02-11 19:04:02,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/namespace/4ad656cd9e0c52e96190aae30cb99234/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:04:02,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:02,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4ad656cd9e0c52e96190aae30cb99234: Waiting for close lock at 1676142242083Running coprocessor pre-close hooks at 1676142242083Disabling compacts and flushes for region at 1676142242083Disabling writes for close at 1676142242083Obtaining lock to block concurrent updates at 1676142242083Preparing flush snapshotting stores in 4ad656cd9e0c52e96190aae30cb99234 at 1676142242083Finished memstore snapshotting hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142242084 (+1 ms)Flushing stores of hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. at 1676142242085 (+1 ms)Flushing 4ad656cd9e0c52e96190aae30cb99234/info: creating writer at 1676142242085Flushing 4ad656cd9e0c52e96190aae30cb99234/info: appending metadata at 1676142242087 (+2 ms)Flushing 4ad656cd9e0c52e96190aae30cb99234/info: closing flushed file at 1676142242087Flushing 4ad656cd9e0c52e96190aae30cb99234/info: reopening flushed file at 1676142242102 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4ad656cd9e0c52e96190aae30cb99234 in 23ms, sequenceid=6, compaction requested=false at 1676142242106 (+4 ms)Writing region close event to WAL at 1676142242109 (+3 ms)Running coprocessor post-close hooks at 1676142242112 (+3 ms)Closed at 1676142242112 2023-02-11 19:04:02,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142239751.4ad656cd9e0c52e96190aae30cb99234. 2023-02-11 19:04:02,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 899ffccbf00f412ab17267698a274a3e 2023-02-11 19:04:02,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/.tmp/table/9b8da876a32a4d2f97acc934004c5740 2023-02-11 19:04:02,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b8da876a32a4d2f97acc934004c5740 2023-02-11 19:04:02,125 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/.tmp/info/9f1ad3e5158e45c79f188fb668772faf as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/info/9f1ad3e5158e45c79f188fb668772faf 2023-02-11 19:04:02,127 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:02,129 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:02,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f1ad3e5158e45c79f188fb668772faf 2023-02-11 19:04:02,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/info/9f1ad3e5158e45c79f188fb668772faf, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 19:04:02,131 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/.tmp/rep_barrier/899ffccbf00f412ab17267698a274a3e as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/rep_barrier/899ffccbf00f412ab17267698a274a3e 2023-02-11 19:04:02,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 899ffccbf00f412ab17267698a274a3e 2023-02-11 19:04:02,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/rep_barrier/899ffccbf00f412ab17267698a274a3e, entries=1, sequenceid=21, filesize=5.1 K 2023-02-11 19:04:02,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/.tmp/table/9b8da876a32a4d2f97acc934004c5740 as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/table/9b8da876a32a4d2f97acc934004c5740 2023-02-11 19:04:02,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b8da876a32a4d2f97acc934004c5740 2023-02-11 19:04:02,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/table/9b8da876a32a4d2f97acc934004c5740, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 19:04:02,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false 2023-02-11 19:04:02,138 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 19:04:02,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 19:04:02,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:04:02,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:04:02,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142242084Running coprocessor pre-close hooks at 1676142242084Disabling compacts and flushes for region at 1676142242084Disabling writes for close at 1676142242084Obtaining lock to block concurrent updates at 1676142242084Preparing flush snapshotting stores in 1588230740 at 1676142242084Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676142242085 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676142242085Flushing 1588230740/info: creating writer at 1676142242085Flushing 1588230740/info: appending metadata at 1676142242087 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676142242087Flushing 1588230740/rep_barrier: creating writer at 1676142242099 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676142242103 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676142242103Flushing 1588230740/table: creating writer at 1676142242114 (+11 ms)Flushing 1588230740/table: appending metadata at 1676142242116 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676142242116Flushing 1588230740/info: reopening flushed file at 1676142242125 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676142242131 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676142242134 (+3 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false at 1676142242138 (+4 ms)Writing region close event to WAL at 1676142242139 (+1 ms)Running coprocessor post-close hooks at 1676142242142 (+3 ms)Closed at 1676142242142 2023-02-11 19:04:02,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:04:02,188 DEBUG [RS:0;jenkins-hbase4:45223] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/oldWALs 2023-02-11 19:04:02,188 INFO [RS:0;jenkins-hbase4:45223] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45223%2C1676142239116:(num 1676142240453) 2023-02-11 19:04:02,188 DEBUG [RS:0;jenkins-hbase4:45223] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,188 INFO [RS:0;jenkins-hbase4:45223] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:02,188 INFO [RS:0;jenkins-hbase4:45223] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:04:02,189 INFO [RS:0;jenkins-hbase4:45223] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:04:02,189 INFO [RS:0;jenkins-hbase4:45223] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:04:02,189 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:04:02,189 INFO [RS:0;jenkins-hbase4:45223] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:04:02,190 INFO [RS:0;jenkins-hbase4:45223] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45223 2023-02-11 19:04:02,191 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:02,191 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:02,191 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e48145b rejected from java.util.concurrent.ThreadPoolExecutor@7a779f4a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,191 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45223,1676142239116 2023-02-11 19:04:02,191 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:02,191 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:02,191 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30d41390 rejected from java.util.concurrent.ThreadPoolExecutor@7a779f4a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,193 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45223,1676142239116] 2023-02-11 19:04:02,193 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45223,1676142239116; numProcessing=1 2023-02-11 19:04:02,194 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45223,1676142239116 already deleted, retry=false 2023-02-11 19:04:02,194 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45223,1676142239116 expired; onlineServers=1 2023-02-11 19:04:02,284 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40929,1676142239149; all regions closed. 2023-02-11 19:04:02,288 DEBUG [RS:1;jenkins-hbase4:40929] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/oldWALs 2023-02-11 19:04:02,288 INFO [RS:1;jenkins-hbase4:40929] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40929%2C1676142239149.meta:.meta(num 1676142239681) 2023-02-11 19:04:02,293 DEBUG [RS:1;jenkins-hbase4:40929] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/oldWALs 2023-02-11 19:04:02,293 INFO [RS:1;jenkins-hbase4:40929] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40929%2C1676142239149:(num 1676142240094) 2023-02-11 19:04:02,293 DEBUG [RS:1;jenkins-hbase4:40929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,293 INFO [RS:1;jenkins-hbase4:40929] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:02,293 INFO [RS:1;jenkins-hbase4:40929] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:04:02,293 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:04:02,294 INFO [RS:1;jenkins-hbase4:40929] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40929 2023-02-11 19:04:02,296 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40929,1676142239149 2023-02-11 19:04:02,296 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:02,296 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3747ac7b rejected from java.util.concurrent.ThreadPoolExecutor@33783e4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,297 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40929,1676142239149] 2023-02-11 19:04:02,297 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40929,1676142239149; numProcessing=2 2023-02-11 19:04:02,299 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40929,1676142239149 already deleted, retry=false 2023-02-11 19:04:02,299 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40929,1676142239149 expired; onlineServers=0 2023-02-11 19:04:02,299 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41257,1676142239045' ***** 2023-02-11 19:04:02,299 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:04:02,300 DEBUG [M:0;jenkins-hbase4:41257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d0f7329, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:04:02,300 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41257,1676142239045 2023-02-11 19:04:02,300 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41257,1676142239045; all regions closed. 2023-02-11 19:04:02,300 DEBUG [M:0;jenkins-hbase4:41257] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:02,300 DEBUG [M:0;jenkins-hbase4:41257] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:04:02,300 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:04:02,300 DEBUG [M:0;jenkins-hbase4:41257] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:04:02,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142239320] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142239320,5,FailOnTimeoutGroup] 2023-02-11 19:04:02,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142239320] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142239320,5,FailOnTimeoutGroup] 2023-02-11 19:04:02,301 INFO [M:0;jenkins-hbase4:41257] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:04:02,302 INFO [M:0;jenkins-hbase4:41257] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:04:02,302 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:04:02,302 INFO [M:0;jenkins-hbase4:41257] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:04:02,302 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:02,302 DEBUG [M:0;jenkins-hbase4:41257] master.HMaster(1502): Stopping service threads 2023-02-11 19:04:02,302 INFO [M:0;jenkins-hbase4:41257] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:04:02,302 ERROR [M:0;jenkins-hbase4:41257] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:04:02,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:04:02,303 INFO [M:0;jenkins-hbase4:41257] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:04:02,303 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:04:02,303 DEBUG [M:0;jenkins-hbase4:41257] zookeeper.ZKUtil(398): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 19:04:02,303 WARN [M:0;jenkins-hbase4:41257] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 19:04:02,303 INFO [M:0;jenkins-hbase4:41257] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:04:02,304 INFO [M:0;jenkins-hbase4:41257] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:04:02,304 DEBUG [M:0;jenkins-hbase4:41257] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:04:02,304 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:02,304 DEBUG [M:0;jenkins-hbase4:41257] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:02,304 DEBUG [M:0;jenkins-hbase4:41257] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:04:02,304 DEBUG [M:0;jenkins-hbase4:41257] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:02,304 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.67 KB heapSize=67.64 KB 2023-02-11 19:04:02,314 INFO [M:0;jenkins-hbase4:41257] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bd96d75c6d0048a695c45459cc2c047f 2023-02-11 19:04:02,318 DEBUG [M:0;jenkins-hbase4:41257] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bd96d75c6d0048a695c45459cc2c047f as hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bd96d75c6d0048a695c45459cc2c047f 2023-02-11 19:04:02,322 INFO [M:0;jenkins-hbase4:41257] regionserver.HStore(1080): Added hdfs://localhost:45135/user/jenkins/test-data/6c07ae79-94b8-80bc-3653-84ee7d81cf14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bd96d75c6d0048a695c45459cc2c047f, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 19:04:02,322 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegion(2947): Finished flush of dataSize ~56.67 KB/58032, heapSize ~67.63 KB/69248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-11 19:04:02,323 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:02,323 DEBUG [M:0;jenkins-hbase4:41257] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142242304Disabling compacts and flushes for region at 1676142242304Disabling writes for close at 1676142242304Obtaining lock to block concurrent updates at 1676142242304Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142242304Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58032, getHeapSize=69248, getOffHeapSize=0, getCellsCount=145 at 1676142242304Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142242305 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142242305Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142242307 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142242307Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142242319 (+12 ms)Finished flush of dataSize ~56.67 KB/58032, heapSize ~67.63 KB/69248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676142242322 (+3 ms)Writing region close event to WAL at 1676142242323 (+1 ms)Closed at 1676142242323 2023-02-11 19:04:02,325 INFO [M:0;jenkins-hbase4:41257] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:04:02,325 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:04:02,326 INFO [M:0;jenkins-hbase4:41257] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41257 2023-02-11 19:04:02,327 DEBUG [M:0;jenkins-hbase4:41257] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41257,1676142239045 already deleted, retry=false 2023-02-11 19:04:02,479 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:02,479 INFO [M:0;jenkins-hbase4:41257] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41257,1676142239045; zookeeper connection closed. 2023-02-11 19:04:02,479 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f0a5e6d rejected from java.util.concurrent.ThreadPoolExecutor@1b35d954[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,480 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): master:41257-0x10044c4c6ee0000, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:02,480 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22979126 rejected from java.util.concurrent.ThreadPoolExecutor@1b35d954[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,579 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:02,579 INFO [RS:1;jenkins-hbase4:40929] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40929,1676142239149; zookeeper connection closed. 2023-02-11 19:04:02,579 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d681c39 rejected from java.util.concurrent.ThreadPoolExecutor@33783e4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,580 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:40929-0x10044c4c6ee0002, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:02,580 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@353eb14e rejected from java.util.concurrent.ThreadPoolExecutor@33783e4b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,580 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@296e988f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@296e988f 2023-02-11 19:04:02,680 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:02,680 INFO [RS:0;jenkins-hbase4:45223] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45223,1676142239116; zookeeper connection closed. 2023-02-11 19:04:02,680 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@484b7058 rejected from java.util.concurrent.ThreadPoolExecutor@7a779f4a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,680 DEBUG [Listener at localhost/40591-EventThread] zookeeper.ZKWatcher(600): regionserver:45223-0x10044c4c6ee0001, quorum=127.0.0.1:60240, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:02,680 ERROR [Listener at localhost/40591-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f0221c7 rejected from java.util.concurrent.ThreadPoolExecutor@7a779f4a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:02,680 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56ee40ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56ee40ad 2023-02-11 19:04:02,680 INFO [Listener at localhost/40591] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:04:02,680 WARN [Listener at localhost/40591] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:04:02,684 INFO [Listener at localhost/40591] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:04:02,786 WARN [BP-1743822406-172.31.14.131-1676142238316 heartbeating to localhost/127.0.0.1:45135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:04:02,788 WARN [BP-1743822406-172.31.14.131-1676142238316 heartbeating to localhost/127.0.0.1:45135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1743822406-172.31.14.131-1676142238316 (Datanode Uuid 0a5ff5bb-5011-4f8a-a96e-e2f0a0f3d571) service to localhost/127.0.0.1:45135 2023-02-11 19:04:02,789 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/dfs/data/data3/current/BP-1743822406-172.31.14.131-1676142238316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:02,789 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/dfs/data/data4/current/BP-1743822406-172.31.14.131-1676142238316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:02,790 WARN [Listener at localhost/40591] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:04:02,793 INFO [Listener at localhost/40591] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:04:02,837 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:04:02,913 WARN [BP-1743822406-172.31.14.131-1676142238316 heartbeating to localhost/127.0.0.1:45135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:04:02,913 WARN [BP-1743822406-172.31.14.131-1676142238316 heartbeating to localhost/127.0.0.1:45135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1743822406-172.31.14.131-1676142238316 (Datanode Uuid a1b23c96-13ee-43a8-8cce-cef92fa078b3) service to localhost/127.0.0.1:45135 2023-02-11 19:04:02,914 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/dfs/data/data1/current/BP-1743822406-172.31.14.131-1676142238316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:02,914 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/cluster_0d4a2069-fd32-512a-cfc9-0a1c671254f3/dfs/data/data2/current/BP-1743822406-172.31.14.131-1676142238316] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:02,927 INFO [Listener at localhost/40591] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:04:03,040 INFO [Listener at localhost/40591] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:04:03,054 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:04:03,066 INFO [Listener at localhost/40591] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 254) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:45135 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45135 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40591 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45135 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45135 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41257,1676142239045)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:45135 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45135 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45135 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=571 (was 656), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=309 (was 301) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3824 (was 3875) 2023-02-11 19:04:03,079 INFO [Listener at localhost/40591] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=167, AvailableMemoryMB=3823 2023-02-11 19:04:03,089 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/hadoop.log.dir so I do NOT create it in target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47 2023-02-11 19:04:03,089 WARN [Listener at localhost/40591] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 19:04:03,089 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/hadoop.tmp.dir so I do NOT create it in target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47 2023-02-11 19:04:03,089 WARN [Listener at localhost/40591] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/698beeaf-590c-ed9d-5fc0-fbefd76cb58b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 19:04:03,089 DEBUG [Listener at localhost/40591] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47 2023-02-11 19:04:03,089 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 19:04:03,089 INFO [Listener at localhost/40591] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d, deleteOnExit=true 2023-02-11 19:04:03,089 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/test.cache.data in system properties and HBase conf 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/hadoop.log.dir in system properties and HBase conf 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 19:04:03,090 DEBUG [Listener at localhost/40591] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 19:04:03,090 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/nfs.dump.dir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/java.io.tmpdir in system properties and HBase conf 2023-02-11 19:04:03,091 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 19:04:03,092 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 19:04:03,092 INFO [Listener at localhost/40591] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 19:04:03,096 WARN [Listener at localhost/40591] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:04:03,096 WARN [Listener at localhost/40591] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:04:03,133 WARN [Listener at localhost/40591] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:04:03,134 INFO [Listener at localhost/40591] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:04:03,139 INFO [Listener at localhost/40591] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/java.io.tmpdir/Jetty_localhost_41255_hdfs____ymvjof/webapp 2023-02-11 19:04:03,238 INFO [Listener at localhost/40591] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41255 2023-02-11 19:04:03,242 WARN [Listener at localhost/40591] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 19:04:03,243 WARN [Listener at localhost/40591] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 19:04:03,276 WARN [Listener at localhost/46573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:04:03,290 WARN [Listener at localhost/46573] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:04:03,292 WARN [Listener at localhost/46573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:04:03,293 INFO [Listener at localhost/46573] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:04:03,299 INFO [Listener at localhost/46573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/java.io.tmpdir/Jetty_localhost_40381_datanode____g71i6v/webapp 2023-02-11 19:04:03,392 INFO [Listener at localhost/46573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40381 2023-02-11 19:04:03,399 WARN [Listener at localhost/41739] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:04:03,418 WARN [Listener at localhost/41739] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 19:04:03,420 WARN [Listener at localhost/41739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 19:04:03,421 INFO [Listener at localhost/41739] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 19:04:03,430 INFO [Listener at localhost/41739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/java.io.tmpdir/Jetty_localhost_33843_datanode____.p6dqgy/webapp 2023-02-11 19:04:03,498 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ce6d4b60c82b96e: Processing first storage report for DS-b344a5ce-c5f0-432b-8151-6cf1a7537625 from datanode fc5130f8-aa09-4c62-98f2-57b53f57da81 2023-02-11 19:04:03,499 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ce6d4b60c82b96e: from storage DS-b344a5ce-c5f0-432b-8151-6cf1a7537625 node DatanodeRegistration(127.0.0.1:38949, datanodeUuid=fc5130f8-aa09-4c62-98f2-57b53f57da81, infoPort=40977, infoSecurePort=0, ipcPort=41739, storageInfo=lv=-57;cid=testClusterID;nsid=1988373159;c=1676142243098), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:04:03,499 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ce6d4b60c82b96e: Processing first storage report for DS-0dc0931c-2b15-4fac-89cf-228f6d13005c from datanode fc5130f8-aa09-4c62-98f2-57b53f57da81 2023-02-11 19:04:03,499 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ce6d4b60c82b96e: from storage DS-0dc0931c-2b15-4fac-89cf-228f6d13005c node DatanodeRegistration(127.0.0.1:38949, datanodeUuid=fc5130f8-aa09-4c62-98f2-57b53f57da81, infoPort=40977, infoSecurePort=0, ipcPort=41739, storageInfo=lv=-57;cid=testClusterID;nsid=1988373159;c=1676142243098), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:04:03,532 INFO [Listener at localhost/41739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33843 2023-02-11 19:04:03,543 WARN [Listener at localhost/39293] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 19:04:03,638 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6bf88963967a340f: Processing first storage report for DS-cd03f08e-a215-491c-84fb-f17b81197fff from datanode af893c40-c3e3-4c13-969a-19b54a4b4c52 2023-02-11 19:04:03,639 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6bf88963967a340f: from storage DS-cd03f08e-a215-491c-84fb-f17b81197fff node DatanodeRegistration(127.0.0.1:44057, datanodeUuid=af893c40-c3e3-4c13-969a-19b54a4b4c52, infoPort=36785, infoSecurePort=0, ipcPort=39293, storageInfo=lv=-57;cid=testClusterID;nsid=1988373159;c=1676142243098), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 19:04:03,639 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6bf88963967a340f: Processing first storage report for DS-4b63887e-e3be-424e-af8d-e5e0dc199091 from datanode af893c40-c3e3-4c13-969a-19b54a4b4c52 2023-02-11 19:04:03,639 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6bf88963967a340f: from storage DS-4b63887e-e3be-424e-af8d-e5e0dc199091 node DatanodeRegistration(127.0.0.1:44057, datanodeUuid=af893c40-c3e3-4c13-969a-19b54a4b4c52, infoPort=36785, infoSecurePort=0, ipcPort=39293, storageInfo=lv=-57;cid=testClusterID;nsid=1988373159;c=1676142243098), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 19:04:03,650 DEBUG [Listener at localhost/39293] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47 2023-02-11 19:04:03,652 INFO [Listener at localhost/39293] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/zookeeper_0, clientPort=52418, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 19:04:03,653 INFO [Listener at localhost/39293] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52418 2023-02-11 19:04:03,653 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,654 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,665 INFO [Listener at localhost/39293] util.FSUtils(479): Created version file at hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116 with version=8 2023-02-11 19:04:03,665 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,666 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,666 INFO [Listener at localhost/39293] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/hbase-staging 2023-02-11 19:04:03,668 INFO [Listener at localhost/39293] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:04:03,668 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,668 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,668 INFO [Listener at localhost/39293] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:04:03,668 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,669 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:04:03,669 INFO [Listener at localhost/39293] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:04:03,669 INFO [Listener at localhost/39293] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40557 2023-02-11 19:04:03,669 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,670 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,671 INFO [Listener at localhost/39293] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40557 connecting to ZooKeeper ensemble=127.0.0.1:52418 2023-02-11 19:04:03,679 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:405570x0, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:04:03,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40557-0x10044c4d9080000 connected 2023-02-11 19:04:03,695 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:04:03,695 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:03,696 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:04:03,697 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40557 2023-02-11 19:04:03,697 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40557 2023-02-11 19:04:03,700 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40557 2023-02-11 19:04:03,704 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40557 2023-02-11 19:04:03,706 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40557 2023-02-11 19:04:03,706 INFO [Listener at localhost/39293] master.HMaster(439): hbase.rootdir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116, hbase.cluster.distributed=false 2023-02-11 19:04:03,718 INFO [Listener at localhost/39293] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:04:03,718 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,719 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,719 INFO [Listener at localhost/39293] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:04:03,719 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,719 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:04:03,719 INFO [Listener at localhost/39293] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:04:03,719 INFO [Listener at localhost/39293] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40111 2023-02-11 19:04:03,720 INFO [Listener at localhost/39293] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:04:03,720 DEBUG [Listener at localhost/39293] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:04:03,721 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,722 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,723 INFO [Listener at localhost/39293] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40111 connecting to ZooKeeper ensemble=127.0.0.1:52418 2023-02-11 19:04:03,726 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:401110x0, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:04:03,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40111-0x10044c4d9080001 connected 2023-02-11 19:04:03,728 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:04:03,729 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:03,729 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:04:03,730 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40111 2023-02-11 19:04:03,732 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40111 2023-02-11 19:04:03,732 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40111 2023-02-11 19:04:03,732 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40111 2023-02-11 19:04:03,733 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40111 2023-02-11 19:04:03,743 INFO [Listener at localhost/39293] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 19:04:03,743 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,743 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,743 INFO [Listener at localhost/39293] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 19:04:03,744 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 19:04:03,744 INFO [Listener at localhost/39293] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 19:04:03,744 INFO [Listener at localhost/39293] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 19:04:03,745 INFO [Listener at localhost/39293] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38785 2023-02-11 19:04:03,745 INFO [Listener at localhost/39293] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 19:04:03,746 DEBUG [Listener at localhost/39293] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:04:03,746 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,747 INFO [Listener at localhost/39293] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,748 INFO [Listener at localhost/39293] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38785 connecting to ZooKeeper ensemble=127.0.0.1:52418 2023-02-11 19:04:03,753 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:387850x0, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 19:04:03,754 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): regionserver:387850x0, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:04:03,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38785-0x10044c4d9080002 connected 2023-02-11 19:04:03,755 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:03,755 DEBUG [Listener at localhost/39293] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 19:04:03,756 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38785 2023-02-11 19:04:03,757 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38785 2023-02-11 19:04:03,760 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38785 2023-02-11 19:04:03,760 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38785 2023-02-11 19:04:03,760 DEBUG [Listener at localhost/39293] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38785 2023-02-11 19:04:03,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:03,763 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:03,764 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:04:03,764 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:04:03,764 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:03,764 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 19:04:03,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:04:03,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 19:04:03,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40557,1676142243668 from backup master directory 2023-02-11 19:04:03,770 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:03,770 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 19:04:03,770 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:04:03,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:03,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/hbase.id with ID: adbd5fed-fd28-4124-b4b8-c8eaa4b8050c 2023-02-11 19:04:03,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 19:04:03,789 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:04,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x412abb22 to 127.0.0.1:52418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:04,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c29137b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:04,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:04:04,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 19:04:04,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:04:04,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store-tmp 2023-02-11 19:04:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:04:04,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:04,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:04,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:04:04,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:04,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:04,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142244254Disabling compacts and flushes for region at 1676142244254Disabling writes for close at 1676142244255 (+1 ms)Writing region close event to WAL at 1676142244255Closed at 1676142244255 2023-02-11 19:04:04,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/WALs/jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:04,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40557%2C1676142243668, suffix=, logDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/WALs/jenkins-hbase4.apache.org,40557,1676142243668, archiveDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/oldWALs, maxLogs=10 2023-02-11 19:04:04,351 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK] 2023-02-11 19:04:04,351 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK] 2023-02-11 19:04:04,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/WALs/jenkins-hbase4.apache.org,40557,1676142243668/jenkins-hbase4.apache.org%2C40557%2C1676142243668.1676142244258 2023-02-11 19:04:04,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK], DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK]] 2023-02-11 19:04:04,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:04:04,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:04,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:04:04,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:04:04,360 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:04:04,361 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 19:04:04,362 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 19:04:04,362 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:04:04,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:04:04,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 19:04:04,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:04:04,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66882678, jitterRate=-0.003370434045791626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:04:04,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676142244359Initializing all the Stores at 1676142244359Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142244360 (+1 ms)Cleaning up temporary data from old regions at 1676142244364 (+4 ms)Cleaning up detritus from prior splits at 1676142244364Region opened successfully at 1676142244369 (+5 ms) 2023-02-11 19:04:04,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 19:04:04,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 19:04:04,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 19:04:04,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 19:04:04,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 19:04:04,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 19:04:04,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 19:04:04,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 19:04:04,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 19:04:04,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 19:04:04,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 19:04:04,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 19:04:04,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 19:04:04,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 19:04:04,385 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:04,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 19:04:04,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 19:04:04,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 19:04:04,389 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:04,389 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:04,389 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:04,389 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:04,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40557,1676142243668, sessionid=0x10044c4d9080000, setting cluster-up flag (Was=false) 2023-02-11 19:04:04,396 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:04,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 19:04:04,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:04,404 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:04,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 19:04:04,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:04,413 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.hbase-snapshot/.tmp 2023-02-11 19:04:04,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 19:04:04,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:04:04,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:04:04,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:04:04,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 19:04:04,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 19:04:04,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:04:04,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676142274424 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 19:04:04,424 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 19:04:04,424 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 19:04:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 19:04:04,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 19:04:04,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 19:04:04,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 19:04:04,425 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:04:04,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 19:04:04,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 19:04:04,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142244432,5,FailOnTimeoutGroup] 2023-02-11 19:04:04,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142244433,5,FailOnTimeoutGroup] 2023-02-11 19:04:04,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 19:04:04,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,437 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(952): ClusterId : adbd5fed-fd28-4124-b4b8-c8eaa4b8050c 2023-02-11 19:04:04,437 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:04:04,437 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(952): ClusterId : adbd5fed-fd28-4124-b4b8-c8eaa4b8050c 2023-02-11 19:04:04,437 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 19:04:04,440 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:04:04,440 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:04:04,440 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 19:04:04,440 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 19:04:04,443 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:04:04,443 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 19:04:04,445 DEBUG [RS:0;jenkins-hbase4:40111] zookeeper.ReadOnlyZKClient(139): Connect 0x4c9ce8b9 to 127.0.0.1:52418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:04,448 DEBUG [RS:1;jenkins-hbase4:38785] zookeeper.ReadOnlyZKClient(139): Connect 0x2422ed52 to 127.0.0.1:52418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:04,454 DEBUG [RS:0;jenkins-hbase4:40111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425b1f5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:04,454 DEBUG [RS:0;jenkins-hbase4:40111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@466483c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:04:04,460 DEBUG [RS:1;jenkins-hbase4:38785] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ae517a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:04,460 DEBUG [RS:1;jenkins-hbase4:38785] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eda8622, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:04:04,466 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:04:04,466 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 19:04:04,467 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116 2023-02-11 19:04:04,467 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40111 2023-02-11 19:04:04,468 INFO [RS:0;jenkins-hbase4:40111] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:04:04,468 INFO [RS:0;jenkins-hbase4:40111] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:04:04,468 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:04:04,468 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40557,1676142243668 with isa=jenkins-hbase4.apache.org/172.31.14.131:40111, startcode=1676142243718 2023-02-11 19:04:04,469 DEBUG [RS:0;jenkins-hbase4:40111] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:04:04,469 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38785 2023-02-11 19:04:04,469 INFO [RS:1;jenkins-hbase4:38785] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 19:04:04,469 INFO [RS:1;jenkins-hbase4:38785] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 19:04:04,469 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 19:04:04,470 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40557,1676142243668 with isa=jenkins-hbase4.apache.org/172.31.14.131:38785, startcode=1676142243743 2023-02-11 19:04:04,471 DEBUG [RS:1;jenkins-hbase4:38785] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 19:04:04,476 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50839, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:04:04,483 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60773, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 19:04:04,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40557] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,487 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116 2023-02-11 19:04:04,487 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46573 2023-02-11 19:04:04,487 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:04:04,489 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:04,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,493 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116 2023-02-11 19:04:04,493 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46573 2023-02-11 19:04:04,493 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 19:04:04,493 DEBUG [RS:0;jenkins-hbase4:40111] zookeeper.ZKUtil(162): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,493 WARN [RS:0;jenkins-hbase4:40111] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:04:04,493 INFO [RS:0;jenkins-hbase4:40111] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:04:04,493 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,497 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40111,1676142243718] 2023-02-11 19:04:04,497 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38785,1676142243743] 2023-02-11 19:04:04,497 DEBUG [RS:1;jenkins-hbase4:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,497 WARN [RS:1;jenkins-hbase4:38785] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 19:04:04,497 INFO [RS:1;jenkins-hbase4:38785] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:04:04,497 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,512 DEBUG [RS:0;jenkins-hbase4:40111] zookeeper.ZKUtil(162): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,513 DEBUG [RS:0;jenkins-hbase4:40111] zookeeper.ZKUtil(162): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,514 DEBUG [RS:0;jenkins-hbase4:40111] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:04:04,514 INFO [RS:0;jenkins-hbase4:40111] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:04:04,532 INFO [RS:0;jenkins-hbase4:40111] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:04:04,549 INFO [RS:0;jenkins-hbase4:40111] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:04:04,553 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,553 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:04,554 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:04:04,563 DEBUG [RS:1;jenkins-hbase4:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,563 DEBUG [RS:1;jenkins-hbase4:38785] zookeeper.ZKUtil(162): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,564 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 19:04:04,564 INFO [RS:1;jenkins-hbase4:38785] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 19:04:04,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:04:04,566 INFO [RS:1;jenkins-hbase4:38785] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 19:04:04,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/info 2023-02-11 19:04:04,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:04:04,575 INFO [RS:1;jenkins-hbase4:38785] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 19:04:04,575 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,575 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:04:04,576 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 19:04:04,576 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,577 DEBUG [RS:0;jenkins-hbase4:40111] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,581 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:04:04,581 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:04:04,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:04:04,582 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,582 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,582 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,582 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,585 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/table 2023-02-11 19:04:04,586 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:04:04,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,587 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740 2023-02-11 19:04:04,587 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740 2023-02-11 19:04:04,589 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,589 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,589 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,589 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,589 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,589 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 19:04:04,590 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,590 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,590 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,590 DEBUG [RS:1;jenkins-hbase4:38785] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 19:04:04,590 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:04:04,591 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:04:04,596 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,597 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,597 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,598 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:04:04,598 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66777978, jitterRate=-0.004930585622787476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:04:04,599 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676142244554Initializing all the Stores at 1676142244563 (+9 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142244563Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142244566 (+3 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142244566Cleaning up temporary data from old regions at 1676142244588 (+22 ms)Cleaning up detritus from prior splits at 1676142244589 (+1 ms)Region opened successfully at 1676142244598 (+9 ms) 2023-02-11 19:04:04,599 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:04:04,599 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:04:04,599 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:04:04,599 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:04:04,599 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:04:04,599 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:04:04,599 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142244599Disabling compacts and flushes for region at 1676142244599Disabling writes for close at 1676142244599Writing region close event to WAL at 1676142244599Closed at 1676142244599 2023-02-11 19:04:04,600 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 19:04:04,600 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 19:04:04,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 19:04:04,604 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 19:04:04,606 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 19:04:04,608 INFO [RS:0;jenkins-hbase4:40111] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:04:04,608 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40111,1676142243718-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,615 INFO [RS:1;jenkins-hbase4:38785] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 19:04:04,615 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38785,1676142243743-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,620 INFO [RS:0;jenkins-hbase4:40111] regionserver.Replication(203): jenkins-hbase4.apache.org,40111,1676142243718 started 2023-02-11 19:04:04,620 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40111,1676142243718, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40111, sessionid=0x10044c4d9080001 2023-02-11 19:04:04,620 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:04:04,620 DEBUG [RS:0;jenkins-hbase4:40111] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,620 DEBUG [RS:0;jenkins-hbase4:40111] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40111,1676142243718' 2023-02-11 19:04:04,620 DEBUG [RS:0;jenkins-hbase4:40111] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40111,1676142243718' 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:04,621 DEBUG [RS:0;jenkins-hbase4:40111] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:04,622 DEBUG [RS:0;jenkins-hbase4:40111] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:04:04,622 INFO [RS:0;jenkins-hbase4:40111] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:04:04,622 INFO [RS:0;jenkins-hbase4:40111] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:04:04,632 INFO [RS:1;jenkins-hbase4:38785] regionserver.Replication(203): jenkins-hbase4.apache.org,38785,1676142243743 started 2023-02-11 19:04:04,632 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38785,1676142243743, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38785, sessionid=0x10044c4d9080002 2023-02-11 19:04:04,632 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 19:04:04,632 DEBUG [RS:1;jenkins-hbase4:38785] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,632 DEBUG [RS:1;jenkins-hbase4:38785] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38785,1676142243743' 2023-02-11 19:04:04,632 DEBUG [RS:1;jenkins-hbase4:38785] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:04,632 DEBUG [RS:1;jenkins-hbase4:38785] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:04,633 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 19:04:04,633 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 19:04:04,633 DEBUG [RS:1;jenkins-hbase4:38785] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,633 DEBUG [RS:1;jenkins-hbase4:38785] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38785,1676142243743' 2023-02-11 19:04:04,633 DEBUG [RS:1;jenkins-hbase4:38785] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:04,633 DEBUG [RS:1;jenkins-hbase4:38785] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:04,634 DEBUG [RS:1;jenkins-hbase4:38785] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 19:04:04,634 INFO [RS:1;jenkins-hbase4:38785] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 19:04:04,634 INFO [RS:1;jenkins-hbase4:38785] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 19:04:04,757 DEBUG [jenkins-hbase4:40557] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 19:04:04,757 DEBUG [jenkins-hbase4:40557] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:04:04,758 DEBUG [jenkins-hbase4:40557] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:04:04,759 DEBUG [jenkins-hbase4:40557] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:04:04,759 DEBUG [jenkins-hbase4:40557] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:04:04,759 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38785,1676142243743, state=OPENING 2023-02-11 19:04:04,761 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 19:04:04,762 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:04,763 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:04:04,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38785,1676142243743}] 2023-02-11 19:04:04,918 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:04,919 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 19:04:04,920 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45730, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 19:04:04,924 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 19:04:04,924 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 19:04:04,926 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38785%2C1676142243743.meta, suffix=.meta, logDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,38785,1676142243743, archiveDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/oldWALs, maxLogs=32 2023-02-11 19:04:04,943 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK] 2023-02-11 19:04:04,947 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK] 2023-02-11 19:04:04,951 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,38785,1676142243743/jenkins-hbase4.apache.org%2C38785%2C1676142243743.meta.1676142244926.meta 2023-02-11 19:04:04,951 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK], DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK]] 2023-02-11 19:04:04,951 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:04:04,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 19:04:04,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 19:04:04,952 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 19:04:04,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 19:04:04,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:04,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 19:04:04,952 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 19:04:04,953 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 19:04:04,954 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/info 2023-02-11 19:04:04,954 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/info 2023-02-11 19:04:04,954 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 19:04:04,955 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,955 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 19:04:04,956 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:04:04,956 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/rep_barrier 2023-02-11 19:04:04,956 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 19:04:04,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 19:04:04,957 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/table 2023-02-11 19:04:04,957 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/table 2023-02-11 19:04:04,958 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 19:04:04,958 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:04,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740 2023-02-11 19:04:04,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740 2023-02-11 19:04:04,961 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 19:04:04,962 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 19:04:04,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59360893, jitterRate=-0.11545376479625702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 19:04:04,962 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676142244952Writing region info on filesystem at 1676142244952Initializing all the Stores at 1676142244953 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142244953Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142244953Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142244953Cleaning up temporary data from old regions at 1676142244960 (+7 ms)Cleaning up detritus from prior splits at 1676142244960Running coprocessor post-open hooks at 1676142244962 (+2 ms)Region opened successfully at 1676142244962 2023-02-11 19:04:04,963 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676142244918 2023-02-11 19:04:04,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 19:04:04,969 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 19:04:04,970 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38785,1676142243743, state=OPEN 2023-02-11 19:04:04,971 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 19:04:04,971 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 19:04:04,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 19:04:04,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38785,1676142243743 in 208 msec 2023-02-11 19:04:04,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 19:04:04,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 372 msec 2023-02-11 19:04:04,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 560 msec 2023-02-11 19:04:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676142243763, completionTime=-1 2023-02-11 19:04:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 19:04:04,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 19:04:04,978 DEBUG [hconnection-0x17e7ceeb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:04:04,979 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:04:04,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 19:04:04,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676142304980 2023-02-11 19:04:04,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676142364980 2023-02-11 19:04:04,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-11 19:04:04,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40557,1676142243668-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40557,1676142243668-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40557,1676142243668-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40557, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 19:04:04,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 19:04:04,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 19:04:04,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 19:04:04,989 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 19:04:04,990 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:04:04,990 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:04:04,993 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:04,993 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2 empty. 2023-02-11 19:04:04,994 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:04,994 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 19:04:05,025 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 19:04:05,028 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2c28fcd184a6539ed3f69b994cfc3fd2, NAME => 'hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp 2023-02-11 19:04:05,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 2c28fcd184a6539ed3f69b994cfc3fd2, disabling compactions & flushes 2023-02-11 19:04:05,041 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. after waiting 0 ms 2023-02-11 19:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,041 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 2c28fcd184a6539ed3f69b994cfc3fd2: Waiting for close lock at 1676142245041Disabling compacts and flushes for region at 1676142245041Disabling writes for close at 1676142245041Writing region close event to WAL at 1676142245041Closed at 1676142245041 2023-02-11 19:04:05,043 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:04:05,043 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142245043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142245043"}]},"ts":"1676142245043"} 2023-02-11 19:04:05,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:04:05,046 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:04:05,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142245046"}]},"ts":"1676142245046"} 2023-02-11 19:04:05,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 19:04:05,049 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:04:05,050 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:04:05,050 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:04:05,050 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:04:05,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2c28fcd184a6539ed3f69b994cfc3fd2, ASSIGN}] 2023-02-11 19:04:05,052 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2c28fcd184a6539ed3f69b994cfc3fd2, ASSIGN 2023-02-11 19:04:05,053 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2c28fcd184a6539ed3f69b994cfc3fd2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38785,1676142243743; forceNewPlan=false, retain=false 2023-02-11 19:04:05,203 INFO [jenkins-hbase4:40557] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:04:05,203 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2c28fcd184a6539ed3f69b994cfc3fd2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:05,203 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142245203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142245203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142245203"}]},"ts":"1676142245203"} 2023-02-11 19:04:05,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2c28fcd184a6539ed3f69b994cfc3fd2, server=jenkins-hbase4.apache.org,38785,1676142243743}] 2023-02-11 19:04:05,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38785%2C1676142243743, suffix=, logDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,38785,1676142243743, archiveDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/oldWALs, maxLogs=32 2023-02-11 19:04:05,376 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK] 2023-02-11 19:04:05,376 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK] 2023-02-11 19:04:05,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,38785,1676142243743/jenkins-hbase4.apache.org%2C38785%2C1676142243743.1676142245362 2023-02-11 19:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK], DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK]] 2023-02-11 19:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c28fcd184a6539ed3f69b994cfc3fd2, NAME => 'hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,382 INFO [StoreOpener-2c28fcd184a6539ed3f69b994cfc3fd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,383 DEBUG [StoreOpener-2c28fcd184a6539ed3f69b994cfc3fd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/info 2023-02-11 19:04:05,383 DEBUG [StoreOpener-2c28fcd184a6539ed3f69b994cfc3fd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/info 2023-02-11 19:04:05,384 INFO [StoreOpener-2c28fcd184a6539ed3f69b994cfc3fd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c28fcd184a6539ed3f69b994cfc3fd2 columnFamilyName info 2023-02-11 19:04:05,384 INFO [StoreOpener-2c28fcd184a6539ed3f69b994cfc3fd2-1] regionserver.HStore(310): Store=2c28fcd184a6539ed3f69b994cfc3fd2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:05,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:05,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:04:05,390 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2c28fcd184a6539ed3f69b994cfc3fd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61800239, jitterRate=-0.07910467684268951}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 19:04:05,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2c28fcd184a6539ed3f69b994cfc3fd2: Running coprocessor pre-open hook at 1676142245381Writing region info on filesystem at 1676142245381Initializing all the Stores at 1676142245382 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676142245382Cleaning up temporary data from old regions at 1676142245386 (+4 ms)Cleaning up detritus from prior splits at 1676142245386Running coprocessor post-open hooks at 1676142245390 (+4 ms)Region opened successfully at 1676142245390 2023-02-11 19:04:05,390 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2., pid=6, masterSystemTime=1676142245357 2023-02-11 19:04:05,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:05,394 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2c28fcd184a6539ed3f69b994cfc3fd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:05,394 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676142245393"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142245393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142245393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142245393"}]},"ts":"1676142245393"} 2023-02-11 19:04:05,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 19:04:05,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2c28fcd184a6539ed3f69b994cfc3fd2, server=jenkins-hbase4.apache.org,38785,1676142243743 in 190 msec 2023-02-11 19:04:05,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 19:04:05,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2c28fcd184a6539ed3f69b994cfc3fd2, ASSIGN in 346 msec 2023-02-11 19:04:05,398 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:04:05,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142245398"}]},"ts":"1676142245398"} 2023-02-11 19:04:05,400 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 19:04:05,404 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:04:05,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 417 msec 2023-02-11 19:04:05,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 19:04:05,491 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:04:05,491 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:05,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 19:04:05,506 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:04:05,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-11 19:04:05,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 19:04:05,523 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 19:04:05,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-11 19:04:05,541 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 19:04:05,544 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 19:04:05,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.774sec 2023-02-11 19:04:05,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 19:04:05,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 19:04:05,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 19:04:05,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40557,1676142243668-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 19:04:05,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40557,1676142243668-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 19:04:05,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 19:04:05,624 INFO [RS:0;jenkins-hbase4:40111] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40111%2C1676142243718, suffix=, logDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,40111,1676142243718, archiveDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/oldWALs, maxLogs=32 2023-02-11 19:04:05,635 DEBUG [Listener at localhost/39293] zookeeper.ReadOnlyZKClient(139): Connect 0x0a05da2c to 127.0.0.1:52418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:05,638 DEBUG [Listener at localhost/39293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a6d1602, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:05,648 DEBUG [hconnection-0x3a7af116-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:04:05,657 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK] 2023-02-11 19:04:05,657 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK] 2023-02-11 19:04:05,658 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45748, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:04:05,660 INFO [Listener at localhost/39293] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:05,660 DEBUG [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 19:04:05,672 DEBUG [Listener at localhost/39293] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 19:04:05,673 INFO [RS:0;jenkins-hbase4:40111] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/WALs/jenkins-hbase4.apache.org,40111,1676142243718/jenkins-hbase4.apache.org%2C40111%2C1676142243718.1676142245624 2023-02-11 19:04:05,674 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 19:04:05,675 INFO [Listener at localhost/39293] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 19:04:05,675 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 19:04:05,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 19:04:05,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:41718 deadline: 1676142305675, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 19:04:05,676 INFO [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 19:04:05,680 DEBUG [RS:0;jenkins-hbase4:40111] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44057,DS-cd03f08e-a215-491c-84fb-f17b81197fff,DISK], DatanodeInfoWithStorage[127.0.0.1:38949,DS-b344a5ce-c5f0-432b-8151-6cf1a7537625,DISK]] 2023-02-11 19:04:05,686 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 19:04:05,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 19:04:05,696 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 19:04:05,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 19:04:05,697 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 19:04:05,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:05,699 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:05,699 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee empty. 2023-02-11 19:04:05,700 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:05,700 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 19:04:05,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:06,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:06,121 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 19:04:06,122 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 28c77aa88af61af51e84afa4611357ee, NAME => 'testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp 2023-02-11 19:04:06,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:06,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 28c77aa88af61af51e84afa4611357ee, disabling compactions & flushes 2023-02-11 19:04:06,134 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. after waiting 0 ms 2023-02-11 19:04:06,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,134 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,134 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 28c77aa88af61af51e84afa4611357ee: Waiting for close lock at 1676142246134Disabling compacts and flushes for region at 1676142246134Disabling writes for close at 1676142246134Writing region close event to WAL at 1676142246134Closed at 1676142246134 2023-02-11 19:04:06,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 19:04:06,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676142246137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142246137"}]},"ts":"1676142246137"} 2023-02-11 19:04:06,139 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 19:04:06,141 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 19:04:06,141 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142246141"}]},"ts":"1676142246141"} 2023-02-11 19:04:06,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 19:04:06,148 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 19:04:06,149 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 19:04:06,149 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 19:04:06,149 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 19:04:06,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, ASSIGN}] 2023-02-11 19:04:06,151 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, ASSIGN 2023-02-11 19:04:06,152 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38785,1676142243743; forceNewPlan=false, retain=false 2023-02-11 19:04:06,302 INFO [jenkins-hbase4:40557] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 19:04:06,302 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=28c77aa88af61af51e84afa4611357ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:06,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676142246302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142246302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142246302"}]},"ts":"1676142246302"} 2023-02-11 19:04:06,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:06,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 28c77aa88af61af51e84afa4611357ee, server=jenkins-hbase4.apache.org,38785,1676142243743}] 2023-02-11 19:04:06,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 28c77aa88af61af51e84afa4611357ee, NAME => 'testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.', STARTKEY => '', ENDKEY => ''} 2023-02-11 19:04:06,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:06,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,462 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,464 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1 2023-02-11 19:04:06,464 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1 2023-02-11 19:04:06,464 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c77aa88af61af51e84afa4611357ee columnFamilyName f1 2023-02-11 19:04:06,464 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(310): Store=28c77aa88af61af51e84afa4611357ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:06,465 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,466 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2 2023-02-11 19:04:06,466 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2 2023-02-11 19:04:06,466 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c77aa88af61af51e84afa4611357ee columnFamilyName f2 2023-02-11 19:04:06,466 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(310): Store=28c77aa88af61af51e84afa4611357ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:04:06,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:06,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 19:04:06,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 28c77aa88af61af51e84afa4611357ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70751491, jitterRate=0.05427937209606171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:04:06,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 28c77aa88af61af51e84afa4611357ee: Running coprocessor pre-open hook at 1676142246461Writing region info on filesystem at 1676142246461Initializing all the Stores at 1676142246462 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142246462Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142246462Cleaning up temporary data from old regions at 1676142246468 (+6 ms)Cleaning up detritus from prior splits at 1676142246469 (+1 ms)Running coprocessor post-open hooks at 1676142246472 (+3 ms)Region opened successfully at 1676142246472 2023-02-11 19:04:06,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee., pid=12, masterSystemTime=1676142246457 2023-02-11 19:04:06,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=28c77aa88af61af51e84afa4611357ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:06,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676142246475"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676142246475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676142246475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676142246475"}]},"ts":"1676142246475"} 2023-02-11 19:04:06,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 19:04:06,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 28c77aa88af61af51e84afa4611357ee, server=jenkins-hbase4.apache.org,38785,1676142243743 in 172 msec 2023-02-11 19:04:06,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 19:04:06,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, ASSIGN in 333 msec 2023-02-11 19:04:06,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 19:04:06,484 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142246484"}]},"ts":"1676142246484"} 2023-02-11 19:04:06,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 19:04:06,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 19:04:06,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 801 msec 2023-02-11 19:04:06,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 19:04:06,805 INFO [Listener at localhost/39293] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 19:04:06,805 DEBUG [Listener at localhost/39293] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 19:04:06,806 INFO [Listener at localhost/39293] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:04:06,818 INFO [Listener at localhost/39293] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 19:04:06,818 INFO [Listener at localhost/39293] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 19:04:06,818 INFO [Listener at localhost/39293] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 19:04:06,818 INFO [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 19:04:06,866 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38785] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:06,983 INFO [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 19:04:06,983 INFO [Listener at localhost/39293] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 19:04:06,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:04:06,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676142246984 (current time:1676142246984). 2023-02-11 19:04:06,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 19:04:06,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] zookeeper.ReadOnlyZKClient(139): Connect 0x40aa0328 to 127.0.0.1:52418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 19:04:06,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c7352c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 19:04:06,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 19:04:06,994 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45758, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 19:04:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40aa0328 to 127.0.0.1:52418 2023-02-11 19:04:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 19:04:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:04:06,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:04:06,999 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:04:07,000 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676142847000 2023-02-11 19:04:07,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 19:04:07,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 19:04:07,003 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 19:04:07,003 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 19:04:07,003 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 19:04:07,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:04:07,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-11 19:04:07,005 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:04:07,005 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676142847005 2023-02-11 19:04:07,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-11 19:04:07,014 INFO [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-11 19:04:07,014 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:04:07,015 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-11 19:04:07,015 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 19:04:07,016 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,016 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,017 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:07,017 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:07,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:07,017 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:07,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,018 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,018 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:04:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-11 19:04:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-11 19:04:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-11 19:04:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-11 19:04:07,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-11 19:04:07,019 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-11 19:04:07,019 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:04:07,021 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 19:04:07,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-11 19:04:07,021 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-11 19:04:07,021 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40111,1676142243718' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-11 19:04:07,021 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-11 19:04:07,021 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 19:04:07,024 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 19:04:07,024 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-11 19:04:07,024 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38785,1676142243743' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-11 19:04:07,024 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,025 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:07,026 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,026 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:04:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 19:04:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:07,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38785,1676142243743' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-11 19:04:07,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d01f2b[Count = 0] remaining members to acquire global barrier 2023-02-11 19:04:07,028 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 19:04:07,029 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 19:04:07,030 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,030 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:04:07,030 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 19:04:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:07,030 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 19:04:07,030 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. started... 2023-02-11 19:04:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,030 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 19:04:07,030 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-11 19:04:07,030 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 28c77aa88af61af51e84afa4611357ee 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 19:04:07,030 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40111,1676142243718' in zk 2023-02-11 19:04:07,032 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-11 19:04:07,032 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:07,032 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-11 19:04:07,048 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f1/9a4c61a91bbc404abd910b166e885b88 2023-02-11 19:04:07,103 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:04:07,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:04:07,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:04:07,105 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 19:04:07,305 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:04:07,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:04:07,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:04:07,307 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 19:04:07,477 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f2/f8daf51717234d0e8045ef93d10b3e9d 2023-02-11 19:04:07,485 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f1/9a4c61a91bbc404abd910b166e885b88 as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/9a4c61a91bbc404abd910b166e885b88 2023-02-11 19:04:07,491 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/9a4c61a91bbc404abd910b166e885b88, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:04:07,492 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f2/f8daf51717234d0e8045ef93d10b3e9d as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/f8daf51717234d0e8045ef93d10b3e9d 2023-02-11 19:04:07,496 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/f8daf51717234d0e8045ef93d10b3e9d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 19:04:07,497 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 28c77aa88af61af51e84afa4611357ee in 467ms, sequenceid=5, compaction requested=false 2023-02-11 19:04:07,497 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 28c77aa88af61af51e84afa4611357ee: 2023-02-11 19:04:07,497 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-11 19:04:07,497 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 19:04:07,498 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/9a4c61a91bbc404abd910b166e885b88] hfiles 2023-02-11 19:04:07,498 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/9a4c61a91bbc404abd910b166e885b88 for snapshot=testWithMapReduceSingleRegion 2023-02-11 19:04:07,498 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/f8daf51717234d0e8045ef93d10b3e9d] hfiles 2023-02-11 19:04:07,498 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/f8daf51717234d0e8045ef93d10b3e9d for snapshot=testWithMapReduceSingleRegion 2023-02-11 19:04:07,526 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. completed. 2023-02-11 19:04:07,526 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:07,526 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 19:04:07,526 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 19:04:07,526 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,527 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-11 19:04:07,527 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38785,1676142243743' in zk 2023-02-11 19:04:07,528 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-11 19:04:07,528 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,528 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:04:07,529 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-11 19:04:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 19:04:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 19:04:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38785,1676142243743': 2023-02-11 19:04:07,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38785,1676142243743' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 19:04:07,532 INFO [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-11 19:04:07,532 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:04:07,532 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:04:07,532 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-11 19:04:07,532 INFO [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 19:04:07,534 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,534 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,534 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,534 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:07,534 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 19:04:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:07,535 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:07,535 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 19:04:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 19:04:07,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,537 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,537 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:07,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 19:04:07,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,543 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:07,543 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,544 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:07,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:07,543 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 19:04:07,544 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:07,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 19:04:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:07,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-11 19:04:07,544 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-11 19:04:07,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-11 19:04:07,544 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 19:04:07,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 19:04:07,544 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 19:04:07,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 19:04:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 19:04:07,545 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 19:04:07,607 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:04:07,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:04:07,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 19:04:07,608 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 19:04:07,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-11 19:04:07,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-11 19:04:07,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 19:04:07,638 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 19:04:07,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676142247002Consolidate snapshot: testWithMapReduceSingleRegion at 1676142247544 (+542 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676142247544Writing data manifest for testWithMapReduceSingleRegion at 1676142247547 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676142247595 (+48 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676142247637 (+42 ms) 2023-02-11 19:04:07,650 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 19:04:07,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 647 msec 2023-02-11 19:04:08,109 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 19:04:08,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 19:04:08,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 19:04:08,110 INFO [Listener at localhost/39293] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 19:04:08,114 INFO [Listener at localhost/39293] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 19:04:08,119 INFO [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 19:04:08,158 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38785] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,261 INFO [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 19:04:08,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 19:04:08,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 19:04:08,279 INFO [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 19:04:08,279 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:04:08,279 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 19:04:08,279 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 19:04:08,280 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,280 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,281 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:08,281 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:08,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:08,281 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,283 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 19:04:08,284 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 19:04:08,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 19:04:08,286 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 19:04:08,286 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:04:08,286 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 19:04:08,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 19:04:08,292 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 19:04:08,292 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. started... 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 19:04:08,292 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40111,1676142243718' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 19:04:08,292 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 28c77aa88af61af51e84afa4611357ee 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 19:04:08,294 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,294 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,294 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:08,328 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f1/2250c386265e4dbbb7e8ad86a74e73db 2023-02-11 19:04:08,374 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f2/6353ad687adb4141b0a1402a8d9e6801 2023-02-11 19:04:08,378 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f1/2250c386265e4dbbb7e8ad86a74e73db as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/2250c386265e4dbbb7e8ad86a74e73db 2023-02-11 19:04:08,383 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/2250c386265e4dbbb7e8ad86a74e73db, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:04:08,385 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/.tmp/f2/6353ad687adb4141b0a1402a8d9e6801 as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/6353ad687adb4141b0a1402a8d9e6801 2023-02-11 19:04:08,389 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/6353ad687adb4141b0a1402a8d9e6801, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 19:04:08,390 INFO [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 28c77aa88af61af51e84afa4611357ee in 98ms, sequenceid=9, compaction requested=false 2023-02-11 19:04:08,390 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 28c77aa88af61af51e84afa4611357ee: 2023-02-11 19:04:08,390 DEBUG [rs(jenkins-hbase4.apache.org,38785,1676142243743)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,390 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 19:04:08,390 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 19:04:08,390 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,390 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 19:04:08,390 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38785,1676142243743' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 19:04:08,392 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,392 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:04:08,392 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,392 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 19:04:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:04:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:08,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38785,1676142243743' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 19:04:08,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15ef89c9[Count = 0] remaining members to acquire global barrier 2023-02-11 19:04:08,394 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 19:04:08,395 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,397 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,398 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 19:04:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 19:04:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38785,1676142243743' in zk 2023-02-11 19:04:08,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,398 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,398 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 19:04:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 19:04:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 19:04:08,398 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40111,1676142243718' in zk 2023-02-11 19:04:08,399 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,399 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 19:04:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:04:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,38785,1676142243743' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 19:04:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 19:04:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,40111,1676142243718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 19:04:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:04:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:04:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38785,1676142243743': 2023-02-11 19:04:08,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38785,1676142243743' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 19:04:08,403 INFO [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 19:04:08,403 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 19:04:08,403 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 19:04:08,403 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 19:04:08,403 INFO [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 19:04:08,405 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 19:04:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 19:04:08,405 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:08,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:08,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 19:04:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,407 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:04:08,407 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 19:04:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:04:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 19:04:08,409 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 19:04:08,409 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,413 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:08,413 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:08,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,413 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 19:04:08,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:08,414 DEBUG [(jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 19:04:08,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 19:04:08,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 19:04:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:08,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 19:04:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 19:04:08,414 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 19:04:08,415 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 19:04:08,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 19:04:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 19:04:08,515 DEBUG [Listener at localhost/39293] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 19:04:08,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 19:04:08,636 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/hadoop-5226063841419823953.jar 2023-02-11 19:04:08,641 INFO [Listener at localhost/39293] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676142246984 type: FLUSH version: 2 ttl: 0 2023-02-11 19:04:08,642 DEBUG [Listener at localhost/39293] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4/data/default/testWithMapReduce 2023-02-11 19:04:08,642 INFO [Listener at localhost/39293] snapshot.RestoreSnapshotHelper(239): region to add: 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:08,642 INFO [Listener at localhost/39293] snapshot.RestoreSnapshotHelper(585): clone region=28c77aa88af61af51e84afa4611357ee as 28c77aa88af61af51e84afa4611357ee in snapshot testWithMapReduceSingleRegion 2023-02-11 19:04:08,647 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 28c77aa88af61af51e84afa4611357ee, NAME => 'testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4 2023-02-11 19:04:08,663 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:08,663 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a4c61a91bbc404abd910b166e885b88 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-11 19:04:08,665 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f8daf51717234d0e8045ef93d10b3e9d from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-11 19:04:08,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 28c77aa88af61af51e84afa4611357ee, disabling compactions & flushes 2023-02-11 19:04:08,669 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. after waiting 0 ms 2023-02-11 19:04:08,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,669 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:08,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 28c77aa88af61af51e84afa4611357ee: Waiting for close lock at 1676142248669Disabling compacts and flushes for region at 1676142248669Disabling writes for close at 1676142248669Writing region close event to WAL at 1676142248669Closed at 1676142248669 2023-02-11 19:04:08,676 INFO [Listener at localhost/39293] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676142246984 type: FLUSH version: 2 ttl: 0 2023-02-11 19:04:08,676 DEBUG [Listener at localhost/39293] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4 2023-02-11 19:04:08,676 DEBUG [Listener at localhost/39293] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4 2023-02-11 19:04:08,677 DEBUG [Listener at localhost/39293] util.CommonFSUtils(699): |-data/ 2023-02-11 19:04:08,678 DEBUG [Listener at localhost/39293] util.CommonFSUtils(699): |----default/ 2023-02-11 19:04:08,678 DEBUG [Listener at localhost/39293] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 19:04:08,679 DEBUG [Listener at localhost/39293] util.CommonFSUtils(699): |----------28c77aa88af61af51e84afa4611357ee/ 2023-02-11 19:04:08,679 DEBUG [Listener at localhost/39293] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 19:04:08,679 DEBUG [Listener at localhost/39293] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 19:04:08,680 DEBUG [Listener at localhost/39293] util.CommonFSUtils(702): |----------------testWithMapReduce=28c77aa88af61af51e84afa4611357ee-9a4c61a91bbc404abd910b166e885b88 2023-02-11 19:04:08,680 DEBUG [Listener at localhost/39293] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 19:04:08,680 DEBUG [Listener at localhost/39293] util.CommonFSUtils(702): |----------------testWithMapReduce=28c77aa88af61af51e84afa4611357ee-f8daf51717234d0e8045ef93d10b3e9d 2023-02-11 19:04:08,681 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:08,682 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:08,682 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:08,683 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,646 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/hadoop-6860613920938334332.jar 2023-02-11 19:04:09,646 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,647 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,712 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/hadoop-4462521305032223184.jar 2023-02-11 19:04:09,713 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,713 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,713 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,714 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,714 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,714 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,715 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 19:04:09,715 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 19:04:09,715 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 19:04:09,716 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 19:04:09,716 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 19:04:09,717 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 19:04:09,717 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 19:04:09,717 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 19:04:09,718 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 19:04:09,718 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 19:04:09,719 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 19:04:09,719 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:04:09,719 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:04:09,720 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 19:04:09,720 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 19:04:09,795 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/hadoop-1308116663007099564.jar 2023-02-11 19:04:09,796 DEBUG [Listener at localhost/39293] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 19:04:09,803 WARN [Listener at localhost/39293] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 19:04:09,810 WARN [Listener at localhost/39293] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-11 19:04:09,817 INFO [Listener at localhost/39293] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 19:04:09,920 WARN [Listener at localhost/39293] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/mapreduce.cluster.local.dir/1676142249880/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 19:04:09,920 WARN [Listener at localhost/39293] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/mapreduce.cluster.local.dir/1676142249880/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 19:04:09,954 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 19:04:09,954 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 19:04:09,954 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 19:04:09,956 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:09,957 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1 2023-02-11 19:04:09,957 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c77aa88af61af51e84afa4611357ee columnFamilyName f1 2023-02-11 19:04:09,963 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(539): loaded hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/testWithMapReduce=28c77aa88af61af51e84afa4611357ee-9a4c61a91bbc404abd910b166e885b88 2023-02-11 19:04:09,963 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(310): Store=28c77aa88af61af51e84afa4611357ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:09,964 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:09,965 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2 2023-02-11 19:04:09,965 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c77aa88af61af51e84afa4611357ee columnFamilyName f2 2023-02-11 19:04:09,972 DEBUG [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(539): loaded hdfs://localhost:46573/user/jenkins/test-data/9800deab-8b4c-cb20-d1b3-ba1b124871f8/testWithMapReduceSingleRegion/61df92fc-1de9-443f-b6b8-53fda883f2a4/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/testWithMapReduce=28c77aa88af61af51e84afa4611357ee-f8daf51717234d0e8045ef93d10b3e9d 2023-02-11 19:04:09,973 INFO [StoreOpener-28c77aa88af61af51e84afa4611357ee-1] regionserver.HStore(310): Store=28c77aa88af61af51e84afa4611357ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 19:04:09,973 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 19:04:09,973 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 28c77aa88af61af51e84afa4611357ee; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67393908, jitterRate=0.004247486591339111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 19:04:09,973 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 28c77aa88af61af51e84afa4611357ee: Writing region info on filesystem at 1676142249954Initializing all the Stores at 1676142249955 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142249955Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676142249955Region opened successfully at 1676142249973 (+18 ms) 2023-02-11 19:04:10,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 28c77aa88af61af51e84afa4611357ee, disabling compactions & flushes 2023-02-11 19:04:10,111 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:10,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:10,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. after waiting 0 ms 2023-02-11 19:04:10,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:10,112 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:10,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 28c77aa88af61af51e84afa4611357ee: Waiting for close lock at 1676142250111Disabling compacts and flushes for region at 1676142250111Disabling writes for close at 1676142250111Writing region close event to WAL at 1676142250112 (+1 ms)Closed at 1676142250112 2023-02-11 19:04:10,454 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 19:04:10,958 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-11 19:04:10,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-11 19:04:10,962 INFO [Listener at localhost/39293] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 19:04:10,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 19:04:10,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-11 19:04:10,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:04:10,966 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142250966"}]},"ts":"1676142250966"} 2023-02-11 19:04:10,967 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-11 19:04:10,969 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-11 19:04:10,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, UNASSIGN}] 2023-02-11 19:04:10,970 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, UNASSIGN 2023-02-11 19:04:10,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=28c77aa88af61af51e84afa4611357ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:10,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676142250971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676142250971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676142250971"}]},"ts":"1676142250971"} 2023-02-11 19:04:10,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 28c77aa88af61af51e84afa4611357ee, server=jenkins-hbase4.apache.org,38785,1676142243743}] 2023-02-11 19:04:11,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:04:11,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:11,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 28c77aa88af61af51e84afa4611357ee, disabling compactions & flushes 2023-02-11 19:04:11,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:11,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:11,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. after waiting 0 ms 2023-02-11 19:04:11,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:11,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 19:04:11,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee. 2023-02-11 19:04:11,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 28c77aa88af61af51e84afa4611357ee: Waiting for close lock at 1676142251126Running coprocessor pre-close hooks at 1676142251126Disabling compacts and flushes for region at 1676142251126Disabling writes for close at 1676142251126Writing region close event to WAL at 1676142251128 (+2 ms)Running coprocessor post-close hooks at 1676142251133 (+5 ms)Closed at 1676142251134 (+1 ms) 2023-02-11 19:04:11,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:11,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=28c77aa88af61af51e84afa4611357ee, regionState=CLOSED 2023-02-11 19:04:11,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676142251136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676142251136"}]},"ts":"1676142251136"} 2023-02-11 19:04:11,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 19:04:11,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 28c77aa88af61af51e84afa4611357ee, server=jenkins-hbase4.apache.org,38785,1676142243743 in 165 msec 2023-02-11 19:04:11,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 19:04:11,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=28c77aa88af61af51e84afa4611357ee, UNASSIGN in 168 msec 2023-02-11 19:04:11,140 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676142251140"}]},"ts":"1676142251140"} 2023-02-11 19:04:11,141 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-11 19:04:11,142 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-11 19:04:11,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 180 msec 2023-02-11 19:04:11,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 19:04:11,269 INFO [Listener at localhost/39293] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-11 19:04:11,270 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-11 19:04:11,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:04:11,272 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:04:11,273 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:04:11,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:04:11,276 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:11,277 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1, FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2, FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/recovered.edits] 2023-02-11 19:04:11,281 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/2250c386265e4dbbb7e8ad86a74e73db to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/archive/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/2250c386265e4dbbb7e8ad86a74e73db 2023-02-11 19:04:11,282 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/9a4c61a91bbc404abd910b166e885b88 to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/archive/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f1/9a4c61a91bbc404abd910b166e885b88 2023-02-11 19:04:11,285 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/6353ad687adb4141b0a1402a8d9e6801 to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/archive/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/6353ad687adb4141b0a1402a8d9e6801 2023-02-11 19:04:11,286 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/f8daf51717234d0e8045ef93d10b3e9d to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/archive/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/f2/f8daf51717234d0e8045ef93d10b3e9d 2023-02-11 19:04:11,289 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/recovered.edits/12.seqid to hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/archive/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee/recovered.edits/12.seqid 2023-02-11 19:04:11,289 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/.tmp/data/default/testWithMapReduce/28c77aa88af61af51e84afa4611357ee 2023-02-11 19:04:11,289 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 19:04:11,291 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:04:11,293 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-11 19:04:11,295 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-11 19:04:11,296 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:04:11,296 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-11 19:04:11,296 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676142251296"}]},"ts":"9223372036854775807"} 2023-02-11 19:04:11,297 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 19:04:11,297 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 28c77aa88af61af51e84afa4611357ee, NAME => 'testWithMapReduce,,1676142245686.28c77aa88af61af51e84afa4611357ee.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 19:04:11,297 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-11 19:04:11,297 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676142251297"}]},"ts":"9223372036854775807"} 2023-02-11 19:04:11,299 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-11 19:04:11,300 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 19:04:11,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 30 msec 2023-02-11 19:04:11,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40557] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 19:04:11,375 INFO [Listener at localhost/39293] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-11 19:04:11,375 INFO [Listener at localhost/39293] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 19:04:11,375 INFO [Listener at localhost/39293] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 19:04:11,375 DEBUG [Listener at localhost/39293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a05da2c to 127.0.0.1:52418 2023-02-11 19:04:11,375 DEBUG [Listener at localhost/39293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,375 DEBUG [Listener at localhost/39293] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 19:04:11,375 DEBUG [Listener at localhost/39293] util.JVMClusterUtil(257): Found active master hash=1719971551, stopped=false 2023-02-11 19:04:11,375 INFO [Listener at localhost/39293] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:11,377 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:11,377 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:11,377 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:11,377 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 19:04:11,377 INFO [Listener at localhost/39293] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 19:04:11,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:11,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:11,380 DEBUG [Listener at localhost/39293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x412abb22 to 127.0.0.1:52418 2023-02-11 19:04:11,380 DEBUG [Listener at localhost/39293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 19:04:11,380 INFO [Listener at localhost/39293] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40111,1676142243718' ***** 2023-02-11 19:04:11,380 INFO [Listener at localhost/39293] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:04:11,380 INFO [Listener at localhost/39293] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38785,1676142243743' ***** 2023-02-11 19:04:11,380 INFO [Listener at localhost/39293] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 19:04:11,380 INFO [RS:1;jenkins-hbase4:38785] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:04:11,381 INFO [RS:0;jenkins-hbase4:40111] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 19:04:11,381 INFO [RS:1;jenkins-hbase4:38785] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:04:11,381 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:04:11,381 INFO [RS:1;jenkins-hbase4:38785] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:04:11,381 INFO [RS:0;jenkins-hbase4:40111] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 19:04:11,382 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(3304): Received CLOSE for 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:11,381 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 19:04:11,382 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:11,382 INFO [RS:0;jenkins-hbase4:40111] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 19:04:11,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2c28fcd184a6539ed3f69b994cfc3fd2, disabling compactions & flushes 2023-02-11 19:04:11,382 DEBUG [RS:1;jenkins-hbase4:38785] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2422ed52 to 127.0.0.1:52418 2023-02-11 19:04:11,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:11,383 DEBUG [RS:1;jenkins-hbase4:38785] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,382 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:11,383 INFO [RS:1;jenkins-hbase4:38785] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:04:11,383 DEBUG [RS:0;jenkins-hbase4:40111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c9ce8b9 to 127.0.0.1:52418 2023-02-11 19:04:11,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:11,383 DEBUG [RS:0;jenkins-hbase4:40111] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,383 INFO [RS:1;jenkins-hbase4:38785] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:04:11,383 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40111,1676142243718; all regions closed. 2023-02-11 19:04:11,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. after waiting 0 ms 2023-02-11 19:04:11,383 INFO [RS:1;jenkins-hbase4:38785] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:04:11,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:11,383 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 19:04:11,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 2c28fcd184a6539ed3f69b994cfc3fd2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 19:04:11,383 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 19:04:11,383 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 2c28fcd184a6539ed3f69b994cfc3fd2=hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2.} 2023-02-11 19:04:11,384 DEBUG [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1505): Waiting on 1588230740, 2c28fcd184a6539ed3f69b994cfc3fd2 2023-02-11 19:04:11,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 19:04:11,384 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 19:04:11,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 19:04:11,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 19:04:11,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 19:04:11,384 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-11 19:04:11,389 DEBUG [RS:0;jenkins-hbase4:40111] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/oldWALs 2023-02-11 19:04:11,389 INFO [RS:0;jenkins-hbase4:40111] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40111%2C1676142243718:(num 1676142245624) 2023-02-11 19:04:11,389 DEBUG [RS:0;jenkins-hbase4:40111] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,389 INFO [RS:0;jenkins-hbase4:40111] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:11,389 INFO [RS:0;jenkins-hbase4:40111] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 19:04:11,390 INFO [RS:0;jenkins-hbase4:40111] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 19:04:11,390 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:04:11,390 INFO [RS:0;jenkins-hbase4:40111] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 19:04:11,390 INFO [RS:0;jenkins-hbase4:40111] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 19:04:11,391 INFO [RS:0;jenkins-hbase4:40111] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40111 2023-02-11 19:04:11,392 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:11,392 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40111,1676142243718 2023-02-11 19:04:11,392 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:11,392 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:11,392 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a2d3743 rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:11,393 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:11,393 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19e53a0d rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:11,396 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40111,1676142243718] 2023-02-11 19:04:11,396 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40111,1676142243718; numProcessing=1 2023-02-11 19:04:11,399 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40111,1676142243718 already deleted, retry=false 2023-02-11 19:04:11,399 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40111,1676142243718 expired; onlineServers=1 2023-02-11 19:04:11,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/.tmp/info/86be505a96764450b38c3352b095ff70 2023-02-11 19:04:11,403 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/.tmp/info/ce0aa090337e42008c9033d361e65a22 2023-02-11 19:04:11,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/.tmp/info/86be505a96764450b38c3352b095ff70 as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/info/86be505a96764450b38c3352b095ff70 2023-02-11 19:04:11,407 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce0aa090337e42008c9033d361e65a22 2023-02-11 19:04:11,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/info/86be505a96764450b38c3352b095ff70, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 19:04:11,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2c28fcd184a6539ed3f69b994cfc3fd2 in 27ms, sequenceid=6, compaction requested=false 2023-02-11 19:04:11,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/namespace/2c28fcd184a6539ed3f69b994cfc3fd2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 19:04:11,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:11,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2c28fcd184a6539ed3f69b994cfc3fd2: Waiting for close lock at 1676142251382Running coprocessor pre-close hooks at 1676142251382Disabling compacts and flushes for region at 1676142251382Disabling writes for close at 1676142251383 (+1 ms)Obtaining lock to block concurrent updates at 1676142251383Preparing flush snapshotting stores in 2c28fcd184a6539ed3f69b994cfc3fd2 at 1676142251383Finished memstore snapshotting hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676142251383Flushing stores of hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. at 1676142251384 (+1 ms)Flushing 2c28fcd184a6539ed3f69b994cfc3fd2/info: creating writer at 1676142251384Flushing 2c28fcd184a6539ed3f69b994cfc3fd2/info: appending metadata at 1676142251388 (+4 ms)Flushing 2c28fcd184a6539ed3f69b994cfc3fd2/info: closing flushed file at 1676142251388Flushing 2c28fcd184a6539ed3f69b994cfc3fd2/info: reopening flushed file at 1676142251406 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2c28fcd184a6539ed3f69b994cfc3fd2 in 27ms, sequenceid=6, compaction requested=false at 1676142251410 (+4 ms)Writing region close event to WAL at 1676142251411 (+1 ms)Running coprocessor post-close hooks at 1676142251414 (+3 ms)Closed at 1676142251418 (+4 ms) 2023-02-11 19:04:11,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676142244987.2c28fcd184a6539ed3f69b994cfc3fd2. 2023-02-11 19:04:11,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/.tmp/rep_barrier/bcec8c2681454b6f88ad25d70ea6aa0a 2023-02-11 19:04:11,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcec8c2681454b6f88ad25d70ea6aa0a 2023-02-11 19:04:11,436 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:11,436 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:11,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/.tmp/table/be4384a17deb42ada4b14585278a5023 2023-02-11 19:04:11,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be4384a17deb42ada4b14585278a5023 2023-02-11 19:04:11,455 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/.tmp/info/ce0aa090337e42008c9033d361e65a22 as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/info/ce0aa090337e42008c9033d361e65a22 2023-02-11 19:04:11,459 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce0aa090337e42008c9033d361e65a22 2023-02-11 19:04:11,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/info/ce0aa090337e42008c9033d361e65a22, entries=12, sequenceid=21, filesize=6.2 K 2023-02-11 19:04:11,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/.tmp/rep_barrier/bcec8c2681454b6f88ad25d70ea6aa0a as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/rep_barrier/bcec8c2681454b6f88ad25d70ea6aa0a 2023-02-11 19:04:11,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcec8c2681454b6f88ad25d70ea6aa0a 2023-02-11 19:04:11,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/rep_barrier/bcec8c2681454b6f88ad25d70ea6aa0a, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 19:04:11,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/.tmp/table/be4384a17deb42ada4b14585278a5023 as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/table/be4384a17deb42ada4b14585278a5023 2023-02-11 19:04:11,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be4384a17deb42ada4b14585278a5023 2023-02-11 19:04:11,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/table/be4384a17deb42ada4b14585278a5023, entries=4, sequenceid=21, filesize=5.0 K 2023-02-11 19:04:11,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=21, compaction requested=false 2023-02-11 19:04:11,475 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 19:04:11,475 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 19:04:11,477 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 19:04:11,477 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676142251384Running coprocessor pre-close hooks at 1676142251384Disabling compacts and flushes for region at 1676142251384Disabling writes for close at 1676142251384Obtaining lock to block concurrent updates at 1676142251384Preparing flush snapshotting stores in 1588230740 at 1676142251384Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676142251384Flushing stores of hbase:meta,,1.1588230740 at 1676142251384Flushing 1588230740/info: creating writer at 1676142251385 (+1 ms)Flushing 1588230740/info: appending metadata at 1676142251388 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676142251388Flushing 1588230740/rep_barrier: creating writer at 1676142251407 (+19 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676142251409 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676142251409Flushing 1588230740/table: creating writer at 1676142251427 (+18 ms)Flushing 1588230740/table: appending metadata at 1676142251432 (+5 ms)Flushing 1588230740/table: closing flushed file at 1676142251432Flushing 1588230740/info: reopening flushed file at 1676142251456 (+24 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676142251461 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676142251467 (+6 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=21, compaction requested=false at 1676142251471 (+4 ms)Writing region close event to WAL at 1676142251472 (+1 ms)Running coprocessor post-close hooks at 1676142251475 (+3 ms)Closed at 1676142251477 (+2 ms) 2023-02-11 19:04:11,477 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 19:04:11,577 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:11,577 INFO [RS:0;jenkins-hbase4:40111] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40111,1676142243718; zookeeper connection closed. 2023-02-11 19:04:11,577 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@618ec883 rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:11,577 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18496cb5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18496cb5 2023-02-11 19:04:11,577 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:40111-0x10044c4d9080001, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:11,577 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bbaa00f rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:11,584 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38785,1676142243743; all regions closed. 2023-02-11 19:04:11,588 DEBUG [RS:1;jenkins-hbase4:38785] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/oldWALs 2023-02-11 19:04:11,588 INFO [RS:1;jenkins-hbase4:38785] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38785%2C1676142243743.meta:.meta(num 1676142244926) 2023-02-11 19:04:11,592 DEBUG [RS:1;jenkins-hbase4:38785] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/oldWALs 2023-02-11 19:04:11,592 INFO [RS:1;jenkins-hbase4:38785] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38785%2C1676142243743:(num 1676142245362) 2023-02-11 19:04:11,592 DEBUG [RS:1;jenkins-hbase4:38785] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,592 INFO [RS:1;jenkins-hbase4:38785] regionserver.LeaseManager(133): Closed leases 2023-02-11 19:04:11,593 INFO [RS:1;jenkins-hbase4:38785] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 19:04:11,593 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:04:11,596 INFO [RS:1;jenkins-hbase4:38785] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38785 2023-02-11 19:04:11,598 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 19:04:11,598 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38785,1676142243743 2023-02-11 19:04:11,598 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32517f60 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:11,599 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38785,1676142243743] 2023-02-11 19:04:11,599 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38785,1676142243743; numProcessing=2 2023-02-11 19:04:11,600 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38785,1676142243743 already deleted, retry=false 2023-02-11 19:04:11,600 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38785,1676142243743 expired; onlineServers=0 2023-02-11 19:04:11,600 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40557,1676142243668' ***** 2023-02-11 19:04:11,600 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 19:04:11,601 DEBUG [M:0;jenkins-hbase4:40557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62bb36d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 19:04:11,602 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40557,1676142243668 2023-02-11 19:04:11,602 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40557,1676142243668; all regions closed. 2023-02-11 19:04:11,602 DEBUG [M:0;jenkins-hbase4:40557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 19:04:11,602 DEBUG [M:0;jenkins-hbase4:40557] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 19:04:11,602 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 19:04:11,602 DEBUG [M:0;jenkins-hbase4:40557] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 19:04:11,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142244433] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676142244433,5,FailOnTimeoutGroup] 2023-02-11 19:04:11,602 INFO [M:0;jenkins-hbase4:40557] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 19:04:11,603 INFO [M:0;jenkins-hbase4:40557] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 19:04:11,603 INFO [M:0;jenkins-hbase4:40557] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 19:04:11,603 DEBUG [M:0;jenkins-hbase4:40557] master.HMaster(1502): Stopping service threads 2023-02-11 19:04:11,603 INFO [M:0;jenkins-hbase4:40557] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 19:04:11,603 ERROR [M:0;jenkins-hbase4:40557] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 19:04:11,603 INFO [M:0;jenkins-hbase4:40557] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 19:04:11,604 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 19:04:11,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142244432] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676142244432,5,FailOnTimeoutGroup] 2023-02-11 19:04:11,608 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 19:04:11,608 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 19:04:11,609 DEBUG [M:0;jenkins-hbase4:40557] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-11 19:04:11,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 19:04:11,609 DEBUG [M:0;jenkins-hbase4:40557] master.ActiveMasterManager(332): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-11 19:04:11,609 INFO [M:0;jenkins-hbase4:40557] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 19:04:11,610 INFO [M:0;jenkins-hbase4:40557] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 19:04:11,610 DEBUG [M:0;jenkins-hbase4:40557] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 19:04:11,610 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:11,610 DEBUG [M:0;jenkins-hbase4:40557] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:11,610 DEBUG [M:0;jenkins-hbase4:40557] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 19:04:11,610 DEBUG [M:0;jenkins-hbase4:40557] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:11,610 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.72 KB heapSize=65.67 KB 2023-02-11 19:04:11,627 INFO [M:0;jenkins-hbase4:40557] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.72 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/74bd85401eec420cbbf978d069957c9b 2023-02-11 19:04:11,636 DEBUG [M:0;jenkins-hbase4:40557] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/74bd85401eec420cbbf978d069957c9b as hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/74bd85401eec420cbbf978d069957c9b 2023-02-11 19:04:11,640 INFO [M:0;jenkins-hbase4:40557] regionserver.HStore(1080): Added hdfs://localhost:46573/user/jenkins/test-data/bcf5f9b3-6a0e-97c6-288f-49d3b93c6116/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/74bd85401eec420cbbf978d069957c9b, entries=17, sequenceid=132, filesize=8.6 K 2023-02-11 19:04:11,641 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegion(2947): Finished flush of dataSize ~54.72 KB/56037, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=132, compaction requested=false 2023-02-11 19:04:11,646 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 19:04:11,646 DEBUG [M:0;jenkins-hbase4:40557] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676142251610Disabling compacts and flushes for region at 1676142251610Disabling writes for close at 1676142251610Obtaining lock to block concurrent updates at 1676142251610Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676142251610Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56037, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1676142251610Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676142251612 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676142251612Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676142251614 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676142251614Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676142251637 (+23 ms)Finished flush of dataSize ~54.72 KB/56037, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=132, compaction requested=false at 1676142251641 (+4 ms)Writing region close event to WAL at 1676142251646 (+5 ms)Closed at 1676142251646 2023-02-11 19:04:11,655 INFO [M:0;jenkins-hbase4:40557] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 19:04:11,655 INFO [M:0;jenkins-hbase4:40557] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40557 2023-02-11 19:04:11,656 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 19:04:11,667 DEBUG [M:0;jenkins-hbase4:40557] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40557,1676142243668 already deleted, retry=false 2023-02-11 19:04:11,978 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:11,978 INFO [M:0;jenkins-hbase4:40557] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40557,1676142243668; zookeeper connection closed. 2023-02-11 19:04:11,978 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@391a447a rejected from java.util.concurrent.ThreadPoolExecutor@3d25d781[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:11,980 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): master:40557-0x10044c4d9080000, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:11,980 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22c75f80 rejected from java.util.concurrent.ThreadPoolExecutor@3d25d781[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:12,079 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:12,079 INFO [RS:1;jenkins-hbase4:38785] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38785,1676142243743; zookeeper connection closed. 2023-02-11 19:04:12,079 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b46df32 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:12,079 DEBUG [Listener at localhost/39293-EventThread] zookeeper.ZKWatcher(600): regionserver:38785-0x10044c4d9080002, quorum=127.0.0.1:52418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 19:04:12,079 ERROR [Listener at localhost/39293-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@395f190 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 19:04:12,079 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fbef091] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fbef091 2023-02-11 19:04:12,079 INFO [Listener at localhost/39293] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 19:04:12,079 WARN [Listener at localhost/39293] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:04:12,084 INFO [Listener at localhost/39293] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:04:12,188 WARN [BP-1445952267-172.31.14.131-1676142243098 heartbeating to localhost/127.0.0.1:46573] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:04:12,188 WARN [BP-1445952267-172.31.14.131-1676142243098 heartbeating to localhost/127.0.0.1:46573] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1445952267-172.31.14.131-1676142243098 (Datanode Uuid af893c40-c3e3-4c13-969a-19b54a4b4c52) service to localhost/127.0.0.1:46573 2023-02-11 19:04:12,188 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/dfs/data/data3/current/BP-1445952267-172.31.14.131-1676142243098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:12,189 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/dfs/data/data4/current/BP-1445952267-172.31.14.131-1676142243098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:12,190 WARN [Listener at localhost/39293] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 19:04:12,192 INFO [Listener at localhost/39293] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:04:12,199 WARN [BP-1445952267-172.31.14.131-1676142243098 heartbeating to localhost/127.0.0.1:46573] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 19:04:12,200 WARN [BP-1445952267-172.31.14.131-1676142243098 heartbeating to localhost/127.0.0.1:46573] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1445952267-172.31.14.131-1676142243098 (Datanode Uuid fc5130f8-aa09-4c62-98f2-57b53f57da81) service to localhost/127.0.0.1:46573 2023-02-11 19:04:12,200 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/dfs/data/data1/current/BP-1445952267-172.31.14.131-1676142243098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:12,201 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/322bf9ae-34aa-f99a-2e01-c81be8ff0f47/cluster_311caa2d-2404-1140-a32c-a468fb1ba13d/dfs/data/data2/current/BP-1445952267-172.31.14.131-1676142243098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 19:04:12,213 INFO [Listener at localhost/39293] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 19:04:12,329 INFO [Listener at localhost/39293] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 19:04:12,364 INFO [Listener at localhost/39293] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 19:04:12,383 INFO [Listener at localhost/39293] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=285 (was 274) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:46573 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:46573 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:46573 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:46573 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/39293 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:46573 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46573 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:46573 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40557,1676142243668)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=589 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 309) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2711 (was 3823)