2023-02-16 06:01:14,366 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-16 06:01:14,422 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=166, AvailableMemoryMB=4115 2023-02-16 06:01:14,678 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5 2023-02-16 06:01:14,686 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:01:14,686 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1, deleteOnExit=true 2023-02-16 06:01:14,686 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:01:14,687 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/test.cache.data in system properties and HBase conf 2023-02-16 06:01:14,687 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:01:14,687 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:01:14,688 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:01:14,688 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:01:14,688 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:01:14,803 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-16 06:01:15,218 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:01:15,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:15,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:15,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:01:15,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:15,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:01:15,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:01:15,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:15,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:15,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:01:15,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:01:15,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:01:15,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:15,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:01:15,226 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:01:15,734 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:15,741 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:16,108 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-16 06:01:16,322 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-16 06:01:16,341 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:16,385 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:16,427 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/java.io.tmpdir/Jetty_localhost_40369_hdfs____m0y09w/webapp 2023-02-16 06:01:16,588 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40369 2023-02-16 06:01:16,599 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:16,600 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:17,171 WARN [Listener at localhost/32817] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:17,255 WARN [Listener at localhost/32817] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:17,278 WARN [Listener at localhost/32817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:17,286 INFO [Listener at localhost/32817] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:17,292 INFO [Listener at localhost/32817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/java.io.tmpdir/Jetty_localhost_34233_datanode____.wsgo7c/webapp 2023-02-16 06:01:17,408 INFO [Listener at localhost/32817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34233 2023-02-16 06:01:17,858 WARN [Listener at localhost/42569] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:17,887 WARN [Listener at localhost/42569] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:17,892 WARN [Listener at localhost/42569] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:17,894 INFO [Listener at localhost/42569] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:17,903 INFO [Listener at localhost/42569] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/java.io.tmpdir/Jetty_localhost_35625_datanode____.dvoe2q/webapp 2023-02-16 06:01:18,028 INFO [Listener at localhost/42569] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35625 2023-02-16 06:01:18,046 WARN [Listener at localhost/44557] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:18,417 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8dc9f2d461610cd3: Processing first storage report for DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd from datanode 66b5860c-ccd2-46bd-a628-99a1eecdada0 2023-02-16 06:01:18,419 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8dc9f2d461610cd3: from storage DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd node DatanodeRegistration(127.0.0.1:34191, datanodeUuid=66b5860c-ccd2-46bd-a628-99a1eecdada0, infoPort=41365, infoSecurePort=0, ipcPort=44557, storageInfo=lv=-57;cid=testClusterID;nsid=524568422;c=1676527275849), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-16 06:01:18,419 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb02ab17cd6dc397: Processing first storage report for DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2 from datanode 9532290e-61a1-4dcb-b8c1-e06544af2508 2023-02-16 06:01:18,419 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb02ab17cd6dc397: from storage DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2 node DatanodeRegistration(127.0.0.1:45851, datanodeUuid=9532290e-61a1-4dcb-b8c1-e06544af2508, infoPort=36419, infoSecurePort=0, ipcPort=42569, storageInfo=lv=-57;cid=testClusterID;nsid=524568422;c=1676527275849), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:18,420 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8dc9f2d461610cd3: Processing first storage report for DS-35c83e24-249c-4d41-8f2a-9cb806b0b4ec from datanode 66b5860c-ccd2-46bd-a628-99a1eecdada0 2023-02-16 06:01:18,420 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8dc9f2d461610cd3: from storage DS-35c83e24-249c-4d41-8f2a-9cb806b0b4ec node DatanodeRegistration(127.0.0.1:34191, datanodeUuid=66b5860c-ccd2-46bd-a628-99a1eecdada0, infoPort=41365, infoSecurePort=0, ipcPort=44557, storageInfo=lv=-57;cid=testClusterID;nsid=524568422;c=1676527275849), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:18,420 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb02ab17cd6dc397: Processing first storage report for DS-f36b2226-0855-407b-9633-6b4293b03ce3 from datanode 9532290e-61a1-4dcb-b8c1-e06544af2508 2023-02-16 06:01:18,420 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb02ab17cd6dc397: from storage DS-f36b2226-0855-407b-9633-6b4293b03ce3 node DatanodeRegistration(127.0.0.1:45851, datanodeUuid=9532290e-61a1-4dcb-b8c1-e06544af2508, infoPort=36419, infoSecurePort=0, ipcPort=42569, storageInfo=lv=-57;cid=testClusterID;nsid=524568422;c=1676527275849), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:18,539 DEBUG [Listener at localhost/44557] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5 2023-02-16 06:01:18,646 INFO [Listener at localhost/44557] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/zookeeper_0, clientPort=53727, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:01:18,664 INFO [Listener at localhost/44557] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53727 2023-02-16 06:01:18,673 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:18,674 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:19,339 INFO [Listener at localhost/44557] util.FSUtils(479): Created version file at hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41 with version=8 2023-02-16 06:01:19,339 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:19,341 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:19,345 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/hbase-staging 2023-02-16 06:01:19,668 INFO [Listener at localhost/44557] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-16 06:01:20,237 INFO [Listener at localhost/44557] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:20,269 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,269 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,270 INFO [Listener at localhost/44557] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:20,270 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,270 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:20,414 INFO [Listener at localhost/44557] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:20,491 DEBUG [Listener at localhost/44557] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-16 06:01:20,582 INFO [Listener at localhost/44557] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45865 2023-02-16 06:01:20,592 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:20,594 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:20,616 INFO [Listener at localhost/44557] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45865 connecting to ZooKeeper ensemble=127.0.0.1:53727 2023-02-16 06:01:20,667 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:458650x0, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:20,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45865-0x1005bb803e50000 connected 2023-02-16 06:01:20,698 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:20,699 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:20,702 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:20,710 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45865 2023-02-16 06:01:20,711 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45865 2023-02-16 06:01:20,711 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45865 2023-02-16 06:01:20,712 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45865 2023-02-16 06:01:20,712 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45865 2023-02-16 06:01:20,718 INFO [Listener at localhost/44557] master.HMaster(444): hbase.rootdir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41, hbase.cluster.distributed=false 2023-02-16 06:01:20,788 INFO [Listener at localhost/44557] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:20,789 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,789 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,789 INFO [Listener at localhost/44557] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:20,789 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,789 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:20,794 INFO [Listener at localhost/44557] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:20,797 INFO [Listener at localhost/44557] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40759 2023-02-16 06:01:20,799 INFO [Listener at localhost/44557] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:20,806 DEBUG [Listener at localhost/44557] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:20,807 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:20,808 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:20,810 INFO [Listener at localhost/44557] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40759 connecting to ZooKeeper ensemble=127.0.0.1:53727 2023-02-16 06:01:20,818 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:407590x0, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:20,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40759-0x1005bb803e50001 connected 2023-02-16 06:01:20,819 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:20,820 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:20,821 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:20,824 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40759 2023-02-16 06:01:20,824 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40759 2023-02-16 06:01:20,824 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40759 2023-02-16 06:01:20,825 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40759 2023-02-16 06:01:20,825 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40759 2023-02-16 06:01:20,837 INFO [Listener at localhost/44557] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:20,838 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,838 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,838 INFO [Listener at localhost/44557] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:20,838 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:20,839 INFO [Listener at localhost/44557] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:20,839 INFO [Listener at localhost/44557] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:20,840 INFO [Listener at localhost/44557] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44983 2023-02-16 06:01:20,841 INFO [Listener at localhost/44557] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:20,842 DEBUG [Listener at localhost/44557] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:20,843 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:20,844 INFO [Listener at localhost/44557] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:20,847 INFO [Listener at localhost/44557] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44983 connecting to ZooKeeper ensemble=127.0.0.1:53727 2023-02-16 06:01:20,850 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:449830x0, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:20,851 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): regionserver:449830x0, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:20,852 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): regionserver:449830x0, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:20,853 DEBUG [Listener at localhost/44557] zookeeper.ZKUtil(164): regionserver:449830x0, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:20,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44983-0x1005bb803e50002 connected 2023-02-16 06:01:20,856 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44983 2023-02-16 06:01:20,857 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44983 2023-02-16 06:01:20,857 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44983 2023-02-16 06:01:20,858 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44983 2023-02-16 06:01:20,858 DEBUG [Listener at localhost/44557] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44983 2023-02-16 06:01:20,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:20,869 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:20,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:20,892 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:20,892 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:20,892 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:20,892 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:20,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:20,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45865,1676527279500 from backup master directory 2023-02-16 06:01:20,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:20,900 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:20,900 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:20,901 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:20,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:20,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-16 06:01:20,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-16 06:01:21,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/hbase.id with ID: b0d17ef5-877f-4f98-9dcc-dd8aad036b01 2023-02-16 06:01:21,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:21,072 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:21,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2238469d to 127.0.0.1:53727 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:21,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30b017c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:21,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:21,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:01:21,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-16 06:01:21,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-16 06:01:21,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 06:01:21,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 06:01:21,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:21,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store-tmp 2023-02-16 06:01:21,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:21,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:21,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:21,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:21,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:21,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:21,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:21,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:21,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/WALs/jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:21,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45865%2C1676527279500, suffix=, logDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/WALs/jenkins-hbase4.apache.org,45865,1676527279500, archiveDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/oldWALs, maxLogs=10 2023-02-16 06:01:21,371 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK] 2023-02-16 06:01:21,371 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK] 2023-02-16 06:01:21,379 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-16 06:01:21,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/WALs/jenkins-hbase4.apache.org,45865,1676527279500/jenkins-hbase4.apache.org%2C45865%2C1676527279500.1676527281320 2023-02-16 06:01:21,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK], DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK]] 2023-02-16 06:01:21,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:21,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:21,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:21,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:21,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:21,531 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:01:21,559 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:01:21,572 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:21,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:21,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:21,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:21,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:21,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73777309, jitterRate=0.09936757385730743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:21,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:21,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:01:21,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:01:21,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:01:21,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:01:21,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-16 06:01:21,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-16 06:01:21,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:01:21,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:01:21,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:01:21,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:01:21,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:01:21,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:01:21,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:01:21,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:01:21,755 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:21,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:01:21,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:01:21,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:01:21,775 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:21,775 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:21,775 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:21,775 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:21,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45865,1676527279500, sessionid=0x1005bb803e50000, setting cluster-up flag (Was=false) 2023-02-16 06:01:21,792 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:21,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:01:21,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:21,806 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:21,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:01:21,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:21,816 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.hbase-snapshot/.tmp 2023-02-16 06:01:21,862 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(952): ClusterId : b0d17ef5-877f-4f98-9dcc-dd8aad036b01 2023-02-16 06:01:21,862 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(952): ClusterId : b0d17ef5-877f-4f98-9dcc-dd8aad036b01 2023-02-16 06:01:21,870 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:21,870 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:21,878 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:21,878 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:21,879 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:21,879 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:21,883 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:21,884 DEBUG [RS:1;jenkins-hbase4:44983] zookeeper.ReadOnlyZKClient(139): Connect 0x6a3d4524 to 127.0.0.1:53727 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:21,885 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:21,900 DEBUG [RS:0;jenkins-hbase4:40759] zookeeper.ReadOnlyZKClient(139): Connect 0x55b79b91 to 127.0.0.1:53727 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:21,912 DEBUG [RS:1;jenkins-hbase4:44983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64faa613, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:21,916 DEBUG [RS:1;jenkins-hbase4:44983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60c52e54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:21,918 DEBUG [RS:0;jenkins-hbase4:40759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b707f57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:21,918 DEBUG [RS:0;jenkins-hbase4:40759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f4ff0e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:21,946 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44983 2023-02-16 06:01:21,946 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40759 2023-02-16 06:01:21,953 INFO [RS:0;jenkins-hbase4:40759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:21,953 INFO [RS:1;jenkins-hbase4:44983] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:21,956 INFO [RS:1;jenkins-hbase4:44983] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:21,956 INFO [RS:0;jenkins-hbase4:40759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:21,956 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:21,956 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:21,960 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45865,1676527279500 with isa=jenkins-hbase4.apache.org/172.31.14.131:40759, startcode=1676527280787 2023-02-16 06:01:21,961 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45865,1676527279500 with isa=jenkins-hbase4.apache.org/172.31.14.131:44983, startcode=1676527280837 2023-02-16 06:01:21,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:21,982 DEBUG [RS:0;jenkins-hbase4:40759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:21,982 DEBUG [RS:1;jenkins-hbase4:44983] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:21,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527311992 2023-02-16 06:01:21,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:01:22,001 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:22,001 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:01:22,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:01:22,007 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:22,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:01:22,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:01:22,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:01:22,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:01:22,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:01:22,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:01:22,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:01:22,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:01:22,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:01:22,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527282044,5,FailOnTimeoutGroup] 2023-02-16 06:01:22,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527282045,5,FailOnTimeoutGroup] 2023-02-16 06:01:22,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:01:22,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,066 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35669, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:22,066 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38153, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:22,074 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:22,075 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:22,075 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41 2023-02-16 06:01:22,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45865] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,099 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:22,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:22,107 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41 2023-02-16 06:01:22,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/info 2023-02-16 06:01:22,107 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32817 2023-02-16 06:01:22,107 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41 2023-02-16 06:01:22,108 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:22,108 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32817 2023-02-16 06:01:22,108 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:22,108 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:22,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:22,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:22,113 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:22,113 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:22,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:22,115 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:22,116 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:22,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/table 2023-02-16 06:01:22,119 DEBUG [RS:0;jenkins-hbase4:40759] zookeeper.ZKUtil(162): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,119 WARN [RS:0;jenkins-hbase4:40759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:22,120 INFO [RS:0;jenkins-hbase4:40759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:22,120 DEBUG [RS:1;jenkins-hbase4:44983] zookeeper.ZKUtil(162): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,120 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:22,121 WARN [RS:1;jenkins-hbase4:44983] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:22,121 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,121 INFO [RS:1;jenkins-hbase4:44983] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:22,121 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40759,1676527280787] 2023-02-16 06:01:22,122 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,122 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44983,1676527280837] 2023-02-16 06:01:22,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:22,126 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740 2023-02-16 06:01:22,128 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740 2023-02-16 06:01:22,132 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:22,134 DEBUG [RS:0;jenkins-hbase4:40759] zookeeper.ZKUtil(162): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,134 DEBUG [RS:1;jenkins-hbase4:44983] zookeeper.ZKUtil(162): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,134 DEBUG [RS:1;jenkins-hbase4:44983] zookeeper.ZKUtil(162): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,134 DEBUG [RS:0;jenkins-hbase4:40759] zookeeper.ZKUtil(162): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,135 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:22,142 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:22,143 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65444211, jitterRate=-0.024805262684822083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:22,143 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:22,143 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:22,143 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:22,143 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:22,143 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:22,143 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:22,144 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:22,144 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:22,148 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:22,149 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:22,149 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:01:22,148 DEBUG [RS:0;jenkins-hbase4:40759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:22,158 INFO [RS:1;jenkins-hbase4:44983] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:22,158 INFO [RS:0;jenkins-hbase4:40759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:22,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:01:22,174 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:01:22,178 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:01:22,181 INFO [RS:1;jenkins-hbase4:44983] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:22,181 INFO [RS:0;jenkins-hbase4:40759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:22,186 INFO [RS:1;jenkins-hbase4:44983] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:22,186 INFO [RS:0;jenkins-hbase4:40759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:22,187 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,187 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,187 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:22,188 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:22,197 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,197 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,197 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,197 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,198 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:22,198 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:22,198 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:1;jenkins-hbase4:44983] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,199 DEBUG [RS:0;jenkins-hbase4:40759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:22,200 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,200 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,200 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,201 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,201 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,201 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,223 INFO [RS:1;jenkins-hbase4:44983] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:22,223 INFO [RS:0;jenkins-hbase4:40759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:22,226 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40759,1676527280787-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,226 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44983,1676527280837-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,244 INFO [RS:1;jenkins-hbase4:44983] regionserver.Replication(203): jenkins-hbase4.apache.org,44983,1676527280837 started 2023-02-16 06:01:22,244 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44983,1676527280837, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44983, sessionid=0x1005bb803e50002 2023-02-16 06:01:22,244 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:22,244 DEBUG [RS:1;jenkins-hbase4:44983] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,245 DEBUG [RS:1;jenkins-hbase4:44983] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44983,1676527280837' 2023-02-16 06:01:22,245 DEBUG [RS:1;jenkins-hbase4:44983] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:22,245 DEBUG [RS:1;jenkins-hbase4:44983] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:22,246 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:22,246 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:22,246 DEBUG [RS:1;jenkins-hbase4:44983] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,246 DEBUG [RS:1;jenkins-hbase4:44983] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44983,1676527280837' 2023-02-16 06:01:22,246 DEBUG [RS:1;jenkins-hbase4:44983] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:22,247 DEBUG [RS:1;jenkins-hbase4:44983] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:22,247 DEBUG [RS:1;jenkins-hbase4:44983] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:22,247 INFO [RS:1;jenkins-hbase4:44983] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:22,247 INFO [RS:1;jenkins-hbase4:44983] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:22,248 INFO [RS:0;jenkins-hbase4:40759] regionserver.Replication(203): jenkins-hbase4.apache.org,40759,1676527280787 started 2023-02-16 06:01:22,248 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40759,1676527280787, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40759, sessionid=0x1005bb803e50001 2023-02-16 06:01:22,248 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:22,248 DEBUG [RS:0;jenkins-hbase4:40759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,249 DEBUG [RS:0;jenkins-hbase4:40759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40759,1676527280787' 2023-02-16 06:01:22,249 DEBUG [RS:0;jenkins-hbase4:40759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:22,249 DEBUG [RS:0;jenkins-hbase4:40759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:22,250 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:22,250 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:22,250 DEBUG [RS:0;jenkins-hbase4:40759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:22,251 DEBUG [RS:0;jenkins-hbase4:40759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40759,1676527280787' 2023-02-16 06:01:22,251 DEBUG [RS:0;jenkins-hbase4:40759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:22,251 DEBUG [RS:0;jenkins-hbase4:40759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:22,252 DEBUG [RS:0;jenkins-hbase4:40759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:22,252 INFO [RS:0;jenkins-hbase4:40759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:22,252 INFO [RS:0;jenkins-hbase4:40759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:22,330 DEBUG [jenkins-hbase4:45865] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:01:22,334 DEBUG [jenkins-hbase4:45865] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:22,340 DEBUG [jenkins-hbase4:45865] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:22,340 DEBUG [jenkins-hbase4:45865] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:22,340 DEBUG [jenkins-hbase4:45865] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:22,343 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44983,1676527280837, state=OPENING 2023-02-16 06:01:22,350 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:01:22,353 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:22,353 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:22,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:22,544 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:22,546 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:22,549 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:22,562 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:01:22,562 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:22,566 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44983%2C1676527280837.meta, suffix=.meta, logDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,44983,1676527280837, archiveDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/oldWALs, maxLogs=32 2023-02-16 06:01:22,588 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK] 2023-02-16 06:01:22,588 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK] 2023-02-16 06:01:22,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,44983,1676527280837/jenkins-hbase4.apache.org%2C44983%2C1676527280837.meta.1676527282570.meta 2023-02-16 06:01:22,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK], DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK]] 2023-02-16 06:01:22,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:22,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:01:22,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:01:22,619 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:01:22,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:01:22,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:22,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:01:22,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:01:22,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:22,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/info 2023-02-16 06:01:22,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/info 2023-02-16 06:01:22,632 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:22,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:22,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:22,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:22,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:22,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:22,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:22,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:22,639 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/table 2023-02-16 06:01:22,639 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/table 2023-02-16 06:01:22,639 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:22,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:22,642 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740 2023-02-16 06:01:22,645 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740 2023-02-16 06:01:22,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:22,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:22,659 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72577001, jitterRate=0.08148159086704254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:22,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:22,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527282536 2023-02-16 06:01:22,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:01:22,698 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:01:22,698 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44983,1676527280837, state=OPEN 2023-02-16 06:01:22,702 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:01:22,702 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:22,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:01:22,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44983,1676527280837 in 345 msec 2023-02-16 06:01:22,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:01:22,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-02-16 06:01:22,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 835 msec 2023-02-16 06:01:22,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527282718, completionTime=-1 2023-02-16 06:01:22,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:01:22,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:01:22,785 DEBUG [hconnection-0x7dece7f2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:22,788 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55240, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:22,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:01:22,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527342809 2023-02-16 06:01:22,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527402809 2023-02-16 06:01:22,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 90 msec 2023-02-16 06:01:22,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45865,1676527279500-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45865,1676527279500-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45865,1676527279500-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45865, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:22,841 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:01:22,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:01:22,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:22,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:01:22,866 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:22,869 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:22,890 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:22,893 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136 empty. 2023-02-16 06:01:22,894 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:22,894 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:01:22,927 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:22,929 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7bdcc8aa5367f1afa65c06cfc2f9136, NAME => 'hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:22,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:22,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c7bdcc8aa5367f1afa65c06cfc2f9136, disabling compactions & flushes 2023-02-16 06:01:22,949 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:22,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:22,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. after waiting 0 ms 2023-02-16 06:01:22,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:22,950 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:22,950 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c7bdcc8aa5367f1afa65c06cfc2f9136: 2023-02-16 06:01:22,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:22,976 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527282958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527282958"}]},"ts":"1676527282958"} 2023-02-16 06:01:23,007 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:01:23,009 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:23,013 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527283009"}]},"ts":"1676527283009"} 2023-02-16 06:01:23,018 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:01:23,022 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:23,024 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:23,024 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:23,024 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:23,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7bdcc8aa5367f1afa65c06cfc2f9136, ASSIGN}] 2023-02-16 06:01:23,030 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7bdcc8aa5367f1afa65c06cfc2f9136, ASSIGN 2023-02-16 06:01:23,032 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c7bdcc8aa5367f1afa65c06cfc2f9136, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44983,1676527280837; forceNewPlan=false, retain=false 2023-02-16 06:01:23,184 INFO [jenkins-hbase4:45865] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:01:23,186 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7bdcc8aa5367f1afa65c06cfc2f9136, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:23,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527283185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527283185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527283185"}]},"ts":"1676527283185"} 2023-02-16 06:01:23,190 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c7bdcc8aa5367f1afa65c06cfc2f9136, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:23,258 INFO [RS:0;jenkins-hbase4:40759] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40759%2C1676527280787, suffix=, logDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,40759,1676527280787, archiveDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/oldWALs, maxLogs=32 2023-02-16 06:01:23,258 INFO [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44983%2C1676527280837, suffix=, logDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,44983,1676527280837, archiveDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/oldWALs, maxLogs=32 2023-02-16 06:01:23,281 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK] 2023-02-16 06:01:23,281 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK] 2023-02-16 06:01:23,282 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK] 2023-02-16 06:01:23,283 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK] 2023-02-16 06:01:23,289 INFO [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,44983,1676527280837/jenkins-hbase4.apache.org%2C44983%2C1676527280837.1676527283261 2023-02-16 06:01:23,289 INFO [RS:0;jenkins-hbase4:40759] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/WALs/jenkins-hbase4.apache.org,40759,1676527280787/jenkins-hbase4.apache.org%2C40759%2C1676527280787.1676527283260 2023-02-16 06:01:23,292 DEBUG [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK], DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK]] 2023-02-16 06:01:23,295 DEBUG [RS:0;jenkins-hbase4:40759] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34191,DS-d6c9ae1a-ff7f-42e3-85a7-06b86d1bfcbd,DISK], DatanodeInfoWithStorage[127.0.0.1:45851,DS-36a73b90-f745-4d1c-b48f-bf7a3d1032c2,DISK]] 2023-02-16 06:01:23,351 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:23,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7bdcc8aa5367f1afa65c06cfc2f9136, NAME => 'hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:23,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:23,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,355 INFO [StoreOpener-c7bdcc8aa5367f1afa65c06cfc2f9136-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,357 DEBUG [StoreOpener-c7bdcc8aa5367f1afa65c06cfc2f9136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/info 2023-02-16 06:01:23,358 DEBUG [StoreOpener-c7bdcc8aa5367f1afa65c06cfc2f9136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/info 2023-02-16 06:01:23,358 INFO [StoreOpener-c7bdcc8aa5367f1afa65c06cfc2f9136-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7bdcc8aa5367f1afa65c06cfc2f9136 columnFamilyName info 2023-02-16 06:01:23,359 INFO [StoreOpener-c7bdcc8aa5367f1afa65c06cfc2f9136-1] regionserver.HStore(310): Store=c7bdcc8aa5367f1afa65c06cfc2f9136/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:23,361 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:23,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:23,371 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7bdcc8aa5367f1afa65c06cfc2f9136; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70143061, jitterRate=0.04521305859088898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:23,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7bdcc8aa5367f1afa65c06cfc2f9136: 2023-02-16 06:01:23,373 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136., pid=6, masterSystemTime=1676527283344 2023-02-16 06:01:23,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:23,378 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:23,380 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7bdcc8aa5367f1afa65c06cfc2f9136, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:23,380 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527283379"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527283379"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527283379"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527283379"}]},"ts":"1676527283379"} 2023-02-16 06:01:23,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:01:23,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c7bdcc8aa5367f1afa65c06cfc2f9136, server=jenkins-hbase4.apache.org,44983,1676527280837 in 194 msec 2023-02-16 06:01:23,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:01:23,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c7bdcc8aa5367f1afa65c06cfc2f9136, ASSIGN in 361 msec 2023-02-16 06:01:23,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:23,394 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527283394"}]},"ts":"1676527283394"} 2023-02-16 06:01:23,398 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:01:23,401 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:23,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 550 msec 2023-02-16 06:01:23,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:01:23,468 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:23,468 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:23,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:01:23,522 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:23,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-16 06:01:23,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:01:23,548 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:23,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-16 06:01:23,563 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:01:23,566 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:01:23,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.667sec 2023-02-16 06:01:23,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:01:23,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:01:23,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:01:23,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45865,1676527279500-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:01:23,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45865,1676527279500-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:01:23,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:01:23,669 DEBUG [Listener at localhost/44557] zookeeper.ReadOnlyZKClient(139): Connect 0x54183f42 to 127.0.0.1:53727 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:23,674 DEBUG [Listener at localhost/44557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45c9f035, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:23,710 DEBUG [hconnection-0x2c01b7e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:23,722 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54786, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:23,736 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:23,736 DEBUG [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:01:23,748 DEBUG [Listener at localhost/44557] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:01:23,751 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:01:23,756 INFO [Listener at localhost/44557] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 06:01:23,762 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 06:01:23,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:01:23,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:52170 deadline: 1676527343761, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 06:01:23,787 INFO [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 06:01:23,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:23,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 06:01:23,806 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:23,808 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:23,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 06:01:23,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:23,831 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:23,832 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:23,836 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:23,841 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:23,841 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:23,843 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:23,844 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:23,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:23,844 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 empty. 2023-02-16 06:01:23,847 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:23,847 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:23,850 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 empty. 2023-02-16 06:01:23,850 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f empty. 2023-02-16 06:01:23,851 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 empty. 2023-02-16 06:01:23,851 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc empty. 2023-02-16 06:01:23,851 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e empty. 2023-02-16 06:01:23,852 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d empty. 2023-02-16 06:01:23,852 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 empty. 2023-02-16 06:01:23,853 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:23,853 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:23,853 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:23,853 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:23,853 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:23,854 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:23,854 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:23,854 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d empty. 2023-02-16 06:01:23,854 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 empty. 2023-02-16 06:01:23,855 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:23,855 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:23,856 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:23,856 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 06:01:23,927 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:23,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 04887ecd84d8b054339e66cee27da227, NAME => 'testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:23,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7d44aedfaba5db72126598bb1839c800, NAME => 'testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:23,940 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => daa01ccb0e487c4292bd567c1978807d, NAME => 'testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,000 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing daa01ccb0e487c4292bd567c1978807d, disabling compactions & flushes 2023-02-16 06:01:24,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,001 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:24,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 04887ecd84d8b054339e66cee27da227, disabling compactions & flushes 2023-02-16 06:01:24,001 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:24,002 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:24,002 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. after waiting 0 ms 2023-02-16 06:01:24,003 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:24,003 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:24,003 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. after waiting 0 ms 2023-02-16 06:01:24,003 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:24,003 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:24,003 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:24,003 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:24,003 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:24,004 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 837d6d0fbe7d278bbbfa089acf93e13e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,005 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7517f88ed11ddd267ae841bdbe7203cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7d44aedfaba5db72126598bb1839c800, disabling compactions & flushes 2023-02-16 06:01:24,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:24,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:24,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. after waiting 0 ms 2023-02-16 06:01:24,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:24,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:24,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:24,009 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 36d3d2895bce6969129ede92f1762122, NAME => 'testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7517f88ed11ddd267ae841bdbe7203cc, disabling compactions & flushes 2023-02-16 06:01:24,060 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:24,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:24,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. after waiting 0 ms 2023-02-16 06:01:24,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:24,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:24,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:24,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6a0f5ed884463d849746b75f64c0e23f, NAME => 'testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 36d3d2895bce6969129ede92f1762122, disabling compactions & flushes 2023-02-16 06:01:24,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 837d6d0fbe7d278bbbfa089acf93e13e, disabling compactions & flushes 2023-02-16 06:01:24,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. after waiting 0 ms 2023-02-16 06:01:24,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. after waiting 1 ms 2023-02-16 06:01:24,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,064 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,064 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:24,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:24,065 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => cb309f295384b92b146716a3d868cbc4, NAME => 'testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,065 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 61ec816f64cfa470e201b3506a650d01, NAME => 'testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 6a0f5ed884463d849746b75f64c0e23f, disabling compactions & flushes 2023-02-16 06:01:24,093 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:24,093 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:24,093 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. after waiting 0 ms 2023-02-16 06:01:24,093 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:24,093 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:24,093 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:24,093 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ff0137857a747de2bae138ee6b34af0d, NAME => 'testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp 2023-02-16 06:01:24,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 61ec816f64cfa470e201b3506a650d01, disabling compactions & flushes 2023-02-16 06:01:24,100 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:24,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:24,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. after waiting 0 ms 2023-02-16 06:01:24,100 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:24,100 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:24,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:24,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ff0137857a747de2bae138ee6b34af0d, disabling compactions & flushes 2023-02-16 06:01:24,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:24,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:24,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. after waiting 0 ms 2023-02-16 06:01:24,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:24,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:24,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:24,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:24,498 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing cb309f295384b92b146716a3d868cbc4, disabling compactions & flushes 2023-02-16 06:01:24,499 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:24,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:24,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. after waiting 0 ms 2023-02-16 06:01:24,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:24,499 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:24,499 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:24,505 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:24,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,508 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676527283797.36d3d2895bce6969129ede92f1762122.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,508 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,508 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,508 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,509 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,509 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527284506"}]},"ts":"1676527284506"} 2023-02-16 06:01:24,556 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 06:01:24,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:24,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527284558"}]},"ts":"1676527284558"} 2023-02-16 06:01:24,561 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 06:01:24,565 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:24,578 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:24,578 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:24,578 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:24,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, ASSIGN}] 2023-02-16 06:01:24,583 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, ASSIGN 2023-02-16 06:01:24,583 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, ASSIGN 2023-02-16 06:01:24,584 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, ASSIGN 2023-02-16 06:01:24,584 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, ASSIGN 2023-02-16 06:01:24,586 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44983,1676527280837; forceNewPlan=false, retain=false 2023-02-16 06:01:24,586 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40759,1676527280787; forceNewPlan=false, retain=false 2023-02-16 06:01:24,586 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40759,1676527280787; forceNewPlan=false, retain=false 2023-02-16 06:01:24,586 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44983,1676527280837; forceNewPlan=false, retain=false 2023-02-16 06:01:24,587 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, ASSIGN 2023-02-16 06:01:24,587 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, ASSIGN 2023-02-16 06:01:24,588 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, ASSIGN 2023-02-16 06:01:24,588 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, ASSIGN 2023-02-16 06:01:24,589 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, ASSIGN 2023-02-16 06:01:24,590 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40759,1676527280787; forceNewPlan=false, retain=false 2023-02-16 06:01:24,590 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40759,1676527280787; forceNewPlan=false, retain=false 2023-02-16 06:01:24,590 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40759,1676527280787; forceNewPlan=false, retain=false 2023-02-16 06:01:24,591 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44983,1676527280837; forceNewPlan=false, retain=false 2023-02-16 06:01:24,592 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44983,1676527280837; forceNewPlan=false, retain=false 2023-02-16 06:01:24,592 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, ASSIGN 2023-02-16 06:01:24,593 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44983,1676527280837; forceNewPlan=false, retain=false 2023-02-16 06:01:24,737 INFO [jenkins-hbase4:45865] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 06:01:24,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=cb309f295384b92b146716a3d868cbc4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:24,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=61ec816f64cfa470e201b3506a650d01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:24,741 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7517f88ed11ddd267ae841bdbe7203cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:24,741 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=04887ecd84d8b054339e66cee27da227, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:24,741 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284741"}]},"ts":"1676527284741"} 2023-02-16 06:01:24,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=837d6d0fbe7d278bbbfa089acf93e13e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:24,741 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527284740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284740"}]},"ts":"1676527284740"} 2023-02-16 06:01:24,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284741"}]},"ts":"1676527284741"} 2023-02-16 06:01:24,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284740"}]},"ts":"1676527284740"} 2023-02-16 06:01:24,742 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284740"}]},"ts":"1676527284740"} 2023-02-16 06:01:24,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure 7517f88ed11ddd267ae841bdbe7203cc, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:24,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 04887ecd84d8b054339e66cee27da227, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:24,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure 61ec816f64cfa470e201b3506a650d01, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:24,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure cb309f295384b92b146716a3d868cbc4, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:24,752 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6a0f5ed884463d849746b75f64c0e23f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284752"}]},"ts":"1676527284752"} 2023-02-16 06:01:24,754 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=daa01ccb0e487c4292bd567c1978807d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,754 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284754"}]},"ts":"1676527284754"} 2023-02-16 06:01:24,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 837d6d0fbe7d278bbbfa089acf93e13e, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:24,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 6a0f5ed884463d849746b75f64c0e23f, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:24,758 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=7d44aedfaba5db72126598bb1839c800, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,759 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284758"}]},"ts":"1676527284758"} 2023-02-16 06:01:24,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure daa01ccb0e487c4292bd567c1978807d, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:24,760 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ff0137857a747de2bae138ee6b34af0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,761 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527284760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284760"}]},"ts":"1676527284760"} 2023-02-16 06:01:24,765 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 7d44aedfaba5db72126598bb1839c800, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:24,767 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=36d3d2895bce6969129ede92f1762122, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,767 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676527283797.36d3d2895bce6969129ede92f1762122.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527284767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527284767"}]},"ts":"1676527284767"} 2023-02-16 06:01:24,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure ff0137857a747de2bae138ee6b34af0d, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:24,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 36d3d2895bce6969129ede92f1762122, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:24,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 837d6d0fbe7d278bbbfa089acf93e13e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 06:01:24,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,909 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,916 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,917 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:24,917 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1 2023-02-16 06:01:24,917 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1 2023-02-16 06:01:24,918 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 837d6d0fbe7d278bbbfa089acf93e13e columnFamilyName f1 2023-02-16 06:01:24,919 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(310): Store=837d6d0fbe7d278bbbfa089acf93e13e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,920 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,920 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55224, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:24,923 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2 2023-02-16 06:01:24,923 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2 2023-02-16 06:01:24,923 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 837d6d0fbe7d278bbbfa089acf93e13e columnFamilyName f2 2023-02-16 06:01:24,924 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(310): Store=837d6d0fbe7d278bbbfa089acf93e13e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 36d3d2895bce6969129ede92f1762122, NAME => 'testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 06:01:24,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,930 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,932 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1 2023-02-16 06:01:24,932 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1 2023-02-16 06:01:24,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:24,932 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36d3d2895bce6969129ede92f1762122 columnFamilyName f1 2023-02-16 06:01:24,933 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(310): Store=36d3d2895bce6969129ede92f1762122/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,933 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:24,937 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2 2023-02-16 06:01:24,937 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2 2023-02-16 06:01:24,938 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36d3d2895bce6969129ede92f1762122 columnFamilyName f2 2023-02-16 06:01:24,939 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(310): Store=36d3d2895bce6969129ede92f1762122/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:24,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 837d6d0fbe7d278bbbfa089acf93e13e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62569922, jitterRate=-0.06763550639152527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:24,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:24,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e., pid=25, masterSystemTime=1676527284899 2023-02-16 06:01:24,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:24,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:24,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:24,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7517f88ed11ddd267ae841bdbe7203cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 06:01:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=837d6d0fbe7d278bbbfa089acf93e13e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527284949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527284949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527284949"}]},"ts":"1676527284949"} 2023-02-16 06:01:24,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:24,953 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:24,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 36d3d2895bce6969129ede92f1762122; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68081791, jitterRate=0.014497742056846619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:24,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:24,956 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1 2023-02-16 06:01:24,956 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1 2023-02-16 06:01:24,957 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7517f88ed11ddd267ae841bdbe7203cc columnFamilyName f1 2023-02-16 06:01:24,957 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(310): Store=7517f88ed11ddd267ae841bdbe7203cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,958 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-16 06:01:24,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122., pid=30, masterSystemTime=1676527284916 2023-02-16 06:01:24,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 837d6d0fbe7d278bbbfa089acf93e13e, server=jenkins-hbase4.apache.org,44983,1676527280837 in 198 msec 2023-02-16 06:01:24,962 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2 2023-02-16 06:01:24,962 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2 2023-02-16 06:01:24,962 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7517f88ed11ddd267ae841bdbe7203cc columnFamilyName f2 2023-02-16 06:01:24,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,963 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(310): Store=7517f88ed11ddd267ae841bdbe7203cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:24,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:24,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, ASSIGN in 381 msec 2023-02-16 06:01:24,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff0137857a747de2bae138ee6b34af0d, NAME => 'testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 06:01:24,965 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=36d3d2895bce6969129ede92f1762122, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:24,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:24,965 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676527283797.36d3d2895bce6969129ede92f1762122.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527284965"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527284965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527284965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527284965"}]},"ts":"1676527284965"} 2023-02-16 06:01:24,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,968 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,970 DEBUG [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f1 2023-02-16 06:01:24,970 DEBUG [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f1 2023-02-16 06:01:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:24,971 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff0137857a747de2bae138ee6b34af0d columnFamilyName f1 2023-02-16 06:01:24,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-16 06:01:24,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 36d3d2895bce6969129ede92f1762122, server=jenkins-hbase4.apache.org,40759,1676527280787 in 197 msec 2023-02-16 06:01:24,972 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(310): Store=ff0137857a747de2bae138ee6b34af0d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,973 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, ASSIGN in 394 msec 2023-02-16 06:01:24,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:24,985 DEBUG [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f2 2023-02-16 06:01:24,985 DEBUG [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f2 2023-02-16 06:01:24,986 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff0137857a747de2bae138ee6b34af0d columnFamilyName f2 2023-02-16 06:01:24,987 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(310): Store=ff0137857a747de2bae138ee6b34af0d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:24,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:24,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:24,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7517f88ed11ddd267ae841bdbe7203cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62393709, jitterRate=-0.07026128470897675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:24,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:25,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc., pid=21, masterSystemTime=1676527284899 2023-02-16 06:01:25,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:25,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:25,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:25,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:25,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 04887ecd84d8b054339e66cee27da227, NAME => 'testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 06:01:25,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7517f88ed11ddd267ae841bdbe7203cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:25,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527285003"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285003"}]},"ts":"1676527285003"} 2023-02-16 06:01:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,008 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff0137857a747de2bae138ee6b34af0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67873925, jitterRate=0.011400297284126282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:25,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d., pid=29, masterSystemTime=1676527284916 2023-02-16 06:01:25,013 DEBUG [StoreOpener-04887ecd84d8b054339e66cee27da227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f1 2023-02-16 06:01:25,013 DEBUG [StoreOpener-04887ecd84d8b054339e66cee27da227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f1 2023-02-16 06:01:25,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-16 06:01:25,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure 7517f88ed11ddd267ae841bdbe7203cc, server=jenkins-hbase4.apache.org,44983,1676527280837 in 262 msec 2023-02-16 06:01:25,014 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04887ecd84d8b054339e66cee27da227 columnFamilyName f1 2023-02-16 06:01:25,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:25,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:25,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:25,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7d44aedfaba5db72126598bb1839c800, NAME => 'testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 06:01:25,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:25,015 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(310): Store=04887ecd84d8b054339e66cee27da227/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,016 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ff0137857a747de2bae138ee6b34af0d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:25,018 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527285017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285017"}]},"ts":"1676527285017"} 2023-02-16 06:01:25,018 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, ASSIGN in 436 msec 2023-02-16 06:01:25,023 DEBUG [StoreOpener-04887ecd84d8b054339e66cee27da227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f2 2023-02-16 06:01:25,024 DEBUG [StoreOpener-04887ecd84d8b054339e66cee27da227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f2 2023-02-16 06:01:25,024 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04887ecd84d8b054339e66cee27da227 columnFamilyName f2 2023-02-16 06:01:25,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-16 06:01:25,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure ff0137857a747de2bae138ee6b34af0d, server=jenkins-hbase4.apache.org,40759,1676527280787 in 252 msec 2023-02-16 06:01:25,024 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1 2023-02-16 06:01:25,025 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1 2023-02-16 06:01:25,025 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d44aedfaba5db72126598bb1839c800 columnFamilyName f1 2023-02-16 06:01:25,026 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(310): Store=04887ecd84d8b054339e66cee27da227/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,028 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(310): Store=7d44aedfaba5db72126598bb1839c800/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, ASSIGN in 446 msec 2023-02-16 06:01:25,030 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,032 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2 2023-02-16 06:01:25,032 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2 2023-02-16 06:01:25,032 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d44aedfaba5db72126598bb1839c800 columnFamilyName f2 2023-02-16 06:01:25,033 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(310): Store=7d44aedfaba5db72126598bb1839c800/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:25,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 04887ecd84d8b054339e66cee27da227; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61569767, jitterRate=-0.08253897726535797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:25,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:25,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227., pid=22, masterSystemTime=1676527284899 2023-02-16 06:01:25,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:25,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:25,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:25,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb309f295384b92b146716a3d868cbc4, NAME => 'testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 06:01:25,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,045 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=04887ecd84d8b054339e66cee27da227, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:25,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7d44aedfaba5db72126598bb1839c800; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63224112, jitterRate=-0.05788731575012207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:25,045 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527285045"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285045"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285045"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285045"}]},"ts":"1676527285045"} 2023-02-16 06:01:25,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:25,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800., pid=28, masterSystemTime=1676527284916 2023-02-16 06:01:25,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:25,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:25,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:25,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a0f5ed884463d849746b75f64c0e23f, NAME => 'testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 06:01:25,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:25,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,051 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=7d44aedfaba5db72126598bb1839c800, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:25,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,051 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527285051"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285051"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285051"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285051"}]},"ts":"1676527285051"} 2023-02-16 06:01:25,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-16 06:01:25,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 04887ecd84d8b054339e66cee27da227, server=jenkins-hbase4.apache.org,44983,1676527280837 in 301 msec 2023-02-16 06:01:25,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, ASSIGN in 475 msec 2023-02-16 06:01:25,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-16 06:01:25,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 7d44aedfaba5db72126598bb1839c800, server=jenkins-hbase4.apache.org,40759,1676527280787 in 289 msec 2023-02-16 06:01:25,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, ASSIGN in 479 msec 2023-02-16 06:01:25,061 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,063 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1 2023-02-16 06:01:25,064 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1 2023-02-16 06:01:25,064 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f5ed884463d849746b75f64c0e23f columnFamilyName f1 2023-02-16 06:01:25,065 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(310): Store=6a0f5ed884463d849746b75f64c0e23f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,065 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,067 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2 2023-02-16 06:01:25,067 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2 2023-02-16 06:01:25,067 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f5ed884463d849746b75f64c0e23f columnFamilyName f2 2023-02-16 06:01:25,068 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(310): Store=6a0f5ed884463d849746b75f64c0e23f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,072 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,075 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1 2023-02-16 06:01:25,075 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1 2023-02-16 06:01:25,075 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb309f295384b92b146716a3d868cbc4 columnFamilyName f1 2023-02-16 06:01:25,076 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(310): Store=cb309f295384b92b146716a3d868cbc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,076 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,078 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2 2023-02-16 06:01:25,079 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2 2023-02-16 06:01:25,079 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb309f295384b92b146716a3d868cbc4 columnFamilyName f2 2023-02-16 06:01:25,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:25,080 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(310): Store=cb309f295384b92b146716a3d868cbc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a0f5ed884463d849746b75f64c0e23f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61672501, jitterRate=-0.08100812137126923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:25,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f., pid=26, masterSystemTime=1676527284916 2023-02-16 06:01:25,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:25,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:25,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:25,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:25,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => daa01ccb0e487c4292bd567c1978807d, NAME => 'testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 06:01:25,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:25,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,093 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6a0f5ed884463d849746b75f64c0e23f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:25,094 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527285093"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285093"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285093"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285093"}]},"ts":"1676527285093"} 2023-02-16 06:01:25,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-16 06:01:25,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 6a0f5ed884463d849746b75f64c0e23f, server=jenkins-hbase4.apache.org,40759,1676527280787 in 339 msec 2023-02-16 06:01:25,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, ASSIGN in 520 msec 2023-02-16 06:01:25,104 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb309f295384b92b146716a3d868cbc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73390494, jitterRate=0.09360358119010925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:25,107 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1 2023-02-16 06:01:25,107 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1 2023-02-16 06:01:25,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4., pid=24, masterSystemTime=1676527284899 2023-02-16 06:01:25,107 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daa01ccb0e487c4292bd567c1978807d columnFamilyName f1 2023-02-16 06:01:25,108 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(310): Store=daa01ccb0e487c4292bd567c1978807d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,109 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:25,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:25,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:25,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 61ec816f64cfa470e201b3506a650d01, NAME => 'testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 06:01:25,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:25,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,111 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2 2023-02-16 06:01:25,111 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2 2023-02-16 06:01:25,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=cb309f295384b92b146716a3d868cbc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:25,111 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daa01ccb0e487c4292bd567c1978807d columnFamilyName f2 2023-02-16 06:01:25,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527285111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285111"}]},"ts":"1676527285111"} 2023-02-16 06:01:25,112 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(310): Store=daa01ccb0e487c4292bd567c1978807d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,112 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,117 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1 2023-02-16 06:01:25,117 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1 2023-02-16 06:01:25,118 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61ec816f64cfa470e201b3506a650d01 columnFamilyName f1 2023-02-16 06:01:25,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,119 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(310): Store=61ec816f64cfa470e201b3506a650d01/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,119 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-16 06:01:25,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure cb309f295384b92b146716a3d868cbc4, server=jenkins-hbase4.apache.org,44983,1676527280837 in 364 msec 2023-02-16 06:01:25,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:25,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, ASSIGN in 542 msec 2023-02-16 06:01:25,125 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2 2023-02-16 06:01:25,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,125 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2 2023-02-16 06:01:25,126 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61ec816f64cfa470e201b3506a650d01 columnFamilyName f2 2023-02-16 06:01:25,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened daa01ccb0e487c4292bd567c1978807d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62535840, jitterRate=-0.06814336776733398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:25,127 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(310): Store=61ec816f64cfa470e201b3506a650d01/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:25,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d., pid=27, masterSystemTime=1676527284916 2023-02-16 06:01:25,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:25,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:25,131 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=daa01ccb0e487c4292bd567c1978807d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:25,131 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527285131"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285131"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285131"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285131"}]},"ts":"1676527285131"} 2023-02-16 06:01:25,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:25,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:25,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-16 06:01:25,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure daa01ccb0e487c4292bd567c1978807d, server=jenkins-hbase4.apache.org,40759,1676527280787 in 375 msec 2023-02-16 06:01:25,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:25,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, ASSIGN in 559 msec 2023-02-16 06:01:25,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 61ec816f64cfa470e201b3506a650d01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64684219, jitterRate=-0.03613002598285675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:25,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:25,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01., pid=23, masterSystemTime=1676527284899 2023-02-16 06:01:25,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:25,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:25,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=61ec816f64cfa470e201b3506a650d01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:25,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527285144"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527285144"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527285144"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527285144"}]},"ts":"1676527285144"} 2023-02-16 06:01:25,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-16 06:01:25,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure 61ec816f64cfa470e201b3506a650d01, server=jenkins-hbase4.apache.org,44983,1676527280837 in 397 msec 2023-02-16 06:01:25,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-16 06:01:25,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, ASSIGN in 571 msec 2023-02-16 06:01:25,154 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:25,154 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527285154"}]},"ts":"1676527285154"} 2023-02-16 06:01:25,156 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 06:01:25,160 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:25,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.3590 sec 2023-02-16 06:01:25,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:25,954 INFO [Listener at localhost/44557] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 06:01:25,954 DEBUG [Listener at localhost/44557] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 06:01:25,956 INFO [Listener at localhost/44557] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:25,965 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 06:01:25,966 INFO [Listener at localhost/44557] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:25,966 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 06:01:25,966 INFO [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:01:26,099 DEBUG [hconnection-0x2c01b7e-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:26,134 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:26,176 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44983] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:26,177 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:26,531 INFO [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:01:26,535 INFO [Listener at localhost/44557] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:01:26,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:01:26,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527286546 (current time:1676527286546). 2023-02-16 06:01:26,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:01:26,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] zookeeper.ReadOnlyZKClient(139): Connect 0x248e4dfa to 127.0.0.1:53727 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:26,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f90051, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:26,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:26,563 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54792, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:26,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x248e4dfa to 127.0.0.1:53727 2023-02-16 06:01:26,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:26,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:01:26,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:01:26,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:01:26,592 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:01:26,594 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676527886594 2023-02-16 06:01:26,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:01:26,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 06:01:26,597 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:01:26,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:01:26,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 16 msec 2023-02-16 06:01:26,600 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:01:26,601 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676527886601 2023-02-16 06:01:26,601 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:26,601 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:01:26,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-16 06:01:26,630 INFO [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-16 06:01:26,630 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:26,631 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-16 06:01:26,631 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 06:01:26,631 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:26,631 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:26,633 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:26,633 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:26,633 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:26,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:26,634 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,634 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:26,634 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:26,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:26,634 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 06:01:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 06:01:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:26,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 06:01:26,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 06:01:26,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 06:01:26,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 06:01:26,640 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 06:01:26,640 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 06:01:26,640 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:26,640 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 06:01:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 06:01:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 06:01:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 06:01:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40759,1676527280787' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 06:01:26,641 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44983,1676527280837' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 06:01:26,645 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,645 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:26,646 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,646 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,646 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:26,646 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:26,646 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,646 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:26,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40759,1676527280787' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 06:01:26,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f24751b[Count = 1] remaining members to acquire global barrier 2023-02-16 06:01:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:26,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44983,1676527280837' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 06:01:26,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f24751b[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:26,651 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 06:01:26,652 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,653 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,654 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:26,654 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:26,654 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:26,654 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:26,654 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:26,655 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:26,655 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. started... 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. started... 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. started... 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. started... 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. started... 2023-02-16 06:01:26,656 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. started... 2023-02-16 06:01:26,656 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 06:01:26,656 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 06:01:26,656 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:26,656 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:26,658 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 837d6d0fbe7d278bbbfa089acf93e13e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:26,663 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegion(2744): Flushing daa01ccb0e487c4292bd567c1978807d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:26,658 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7d44aedfaba5db72126598bb1839c800 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 06:01:26,663 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7517f88ed11ddd267ae841bdbe7203cc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:26,665 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:26,665 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:26,666 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:26,666 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:26,673 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:26,674 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:26,678 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:26,678 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:26,678 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:26,678 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:26,702 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:26,708 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. completed. 2023-02-16 06:01:26,708 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:26,709 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:26,709 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 06:01:26,709 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. started... 2023-02-16 06:01:26,710 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6a0f5ed884463d849746b75f64c0e23f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:26,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:26,711 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. completed. 2023-02-16 06:01:26,711 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:26,712 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:26,712 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 06:01:26,712 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. started... 2023-02-16 06:01:26,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:26,713 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:01:26,716 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 61ec816f64cfa470e201b3506a650d01 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 06:01:26,887 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f1/74b00ff0000f4da6a7651e7eedbb86aa 2023-02-16 06:01:26,890 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f1/de2ecbc76ba64ef7904b95fa119183a6 2023-02-16 06:01:26,897 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f1/438d7b012fc9468b967d403ef0a5b71f 2023-02-16 06:01:26,903 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f1/961649a0f873402c8bf989fba0a2281c 2023-02-16 06:01:26,904 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f1/b62e4982e9194a958b14614d8994714b 2023-02-16 06:01:26,905 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f1/a0048c28175a4ffd8bbe7977e9169b81 2023-02-16 06:01:26,913 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:26,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:26,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:26,915 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 06:01:27,085 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f2/1b0542af961a4677bc535f4f0b9ba22d 2023-02-16 06:01:27,100 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f2/945ad72fdae949d7a6664457710f67cf 2023-02-16 06:01:27,102 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f2/3cacec267c17449e907522655aadf0f4 2023-02-16 06:01:27,106 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f2/44cae266b8b4413487b90c06a9db9e19 2023-02-16 06:01:27,107 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f2/d87b8ff2ea2d42a690013e13d0085041 2023-02-16 06:01:27,111 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f1/438d7b012fc9468b967d403ef0a5b71f as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/438d7b012fc9468b967d403ef0a5b71f 2023-02-16 06:01:27,117 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f1/de2ecbc76ba64ef7904b95fa119183a6 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/de2ecbc76ba64ef7904b95fa119183a6 2023-02-16 06:01:27,120 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f1/961649a0f873402c8bf989fba0a2281c as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/961649a0f873402c8bf989fba0a2281c 2023-02-16 06:01:27,124 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f1/a0048c28175a4ffd8bbe7977e9169b81 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/a0048c28175a4ffd8bbe7977e9169b81 2023-02-16 06:01:27,124 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f1/b62e4982e9194a958b14614d8994714b as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/b62e4982e9194a958b14614d8994714b 2023-02-16 06:01:27,127 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/438d7b012fc9468b967d403ef0a5b71f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,128 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/de2ecbc76ba64ef7904b95fa119183a6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:27,131 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f2/945ad72fdae949d7a6664457710f67cf as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/945ad72fdae949d7a6664457710f67cf 2023-02-16 06:01:27,132 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f2/1b0542af961a4677bc535f4f0b9ba22d as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/1b0542af961a4677bc535f4f0b9ba22d 2023-02-16 06:01:27,136 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/a0048c28175a4ffd8bbe7977e9169b81, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,136 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/b62e4982e9194a958b14614d8994714b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,137 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/961649a0f873402c8bf989fba0a2281c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,138 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f2/d87b8ff2ea2d42a690013e13d0085041 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/d87b8ff2ea2d42a690013e13d0085041 2023-02-16 06:01:27,140 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f2/44cae266b8b4413487b90c06a9db9e19 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/44cae266b8b4413487b90c06a9db9e19 2023-02-16 06:01:27,142 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f2/3cacec267c17449e907522655aadf0f4 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/3cacec267c17449e907522655aadf0f4 2023-02-16 06:01:27,146 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/945ad72fdae949d7a6664457710f67cf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:27,147 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 61ec816f64cfa470e201b3506a650d01 in 431ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,149 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 06:01:27,152 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:27,153 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,153 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,153 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/de2ecbc76ba64ef7904b95fa119183a6] hfiles 2023-02-16 06:01:27,153 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/de2ecbc76ba64ef7904b95fa119183a6 for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,154 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/d87b8ff2ea2d42a690013e13d0085041, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,155 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 837d6d0fbe7d278bbbfa089acf93e13e in 498ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,160 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:27,160 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,160 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/1b0542af961a4677bc535f4f0b9ba22d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,161 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/3cacec267c17449e907522655aadf0f4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,160 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,162 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/a0048c28175a4ffd8bbe7977e9169b81] hfiles 2023-02-16 06:01:27,162 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/a0048c28175a4ffd8bbe7977e9169b81 for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,162 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for daa01ccb0e487c4292bd567c1978807d in 499ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,162 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:27,163 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,163 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,163 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/b62e4982e9194a958b14614d8994714b] hfiles 2023-02-16 06:01:27,163 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/b62e4982e9194a958b14614d8994714b for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,163 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7517f88ed11ddd267ae841bdbe7203cc in 505ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,163 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/438d7b012fc9468b967d403ef0a5b71f] hfiles 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/3cacec267c17449e907522655aadf0f4] hfiles 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/d87b8ff2ea2d42a690013e13d0085041] hfiles 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/945ad72fdae949d7a6664457710f67cf] hfiles 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/d87b8ff2ea2d42a690013e13d0085041 for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/3cacec267c17449e907522655aadf0f4 for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/438d7b012fc9468b967d403ef0a5b71f for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,164 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/945ad72fdae949d7a6664457710f67cf for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,165 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/1b0542af961a4677bc535f4f0b9ba22d] hfiles 2023-02-16 06:01:27,165 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/1b0542af961a4677bc535f4f0b9ba22d for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,165 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/44cae266b8b4413487b90c06a9db9e19, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,166 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6a0f5ed884463d849746b75f64c0e23f in 456ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,166 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:27,167 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,167 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,167 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/961649a0f873402c8bf989fba0a2281c] hfiles 2023-02-16 06:01:27,167 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/961649a0f873402c8bf989fba0a2281c for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,167 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/44cae266b8b4413487b90c06a9db9e19] hfiles 2023-02-16 06:01:27,167 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/44cae266b8b4413487b90c06a9db9e19 for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. completed. 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. completed. 2023-02-16 06:01:27,200 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:27,200 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. started... 2023-02-16 06:01:27,200 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:27,201 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. started... 2023-02-16 06:01:27,210 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 36d3d2895bce6969129ede92f1762122 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:27,210 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cb309f295384b92b146716a3d868cbc4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:27,216 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:27,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:27,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:27,218 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 06:01:27,219 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. completed. 2023-02-16 06:01:27,219 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:27,219 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 06:01:27,232 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. completed. 2023-02-16 06:01:27,232 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:27,232 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 06:01:27,239 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f1/9d2966c4f9c745708cb9d7b86fdb045a 2023-02-16 06:01:27,252 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f1/47026243d95c48189a54f6f76e465dec 2023-02-16 06:01:27,282 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f2/5d18fcc3ada64a4ab5709034a1e06b8d 2023-02-16 06:01:27,289 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f2/b1a33df8bdea4220b1d6849e3f9bcd22 2023-02-16 06:01:27,292 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f1/9d2966c4f9c745708cb9d7b86fdb045a as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/9d2966c4f9c745708cb9d7b86fdb045a 2023-02-16 06:01:27,298 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f1/47026243d95c48189a54f6f76e465dec as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/47026243d95c48189a54f6f76e465dec 2023-02-16 06:01:27,307 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/47026243d95c48189a54f6f76e465dec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,309 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f2/b1a33df8bdea4220b1d6849e3f9bcd22 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/b1a33df8bdea4220b1d6849e3f9bcd22 2023-02-16 06:01:27,309 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/9d2966c4f9c745708cb9d7b86fdb045a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,311 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f2/5d18fcc3ada64a4ab5709034a1e06b8d as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/5d18fcc3ada64a4ab5709034a1e06b8d 2023-02-16 06:01:27,319 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/b1a33df8bdea4220b1d6849e3f9bcd22, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,321 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 36d3d2895bce6969129ede92f1762122 in 111ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/47026243d95c48189a54f6f76e465dec] hfiles 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/47026243d95c48189a54f6f76e465dec for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/b1a33df8bdea4220b1d6849e3f9bcd22] hfiles 2023-02-16 06:01:27,321 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/b1a33df8bdea4220b1d6849e3f9bcd22 for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,327 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/5d18fcc3ada64a4ab5709034a1e06b8d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:27,328 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cb309f295384b92b146716a3d868cbc4 in 118ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,328 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:27,329 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,329 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,329 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/9d2966c4f9c745708cb9d7b86fdb045a] hfiles 2023-02-16 06:01:27,329 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/9d2966c4f9c745708cb9d7b86fdb045a for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,329 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/5d18fcc3ada64a4ab5709034a1e06b8d] hfiles 2023-02-16 06:01:27,329 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/5d18fcc3ada64a4ab5709034a1e06b8d for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,346 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. completed. 2023-02-16 06:01:27,346 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:27,347 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 06:01:27,349 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. completed. 2023-02-16 06:01:27,349 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 06:01:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 06:01:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,350 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 06:01:27,350 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44983,1676527280837' in zk 2023-02-16 06:01:27,354 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 06:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:27,354 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 06:01:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44983,1676527280837': 2023-02-16 06:01:27,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44983,1676527280837' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 06:01:27,503 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f2/f33d2b9c4bb642cf8e12e56bf0eb458e 2023-02-16 06:01:27,511 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f1/74b00ff0000f4da6a7651e7eedbb86aa as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/74b00ff0000f4da6a7651e7eedbb86aa 2023-02-16 06:01:27,518 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/74b00ff0000f4da6a7651e7eedbb86aa, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:27,520 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f2/f33d2b9c4bb642cf8e12e56bf0eb458e as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/f33d2b9c4bb642cf8e12e56bf0eb458e 2023-02-16 06:01:27,526 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/f33d2b9c4bb642cf8e12e56bf0eb458e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:27,527 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7d44aedfaba5db72126598bb1839c800 in 870ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:27,527 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:27,528 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,528 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:27,528 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/74b00ff0000f4da6a7651e7eedbb86aa] hfiles 2023-02-16 06:01:27,528 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/74b00ff0000f4da6a7651e7eedbb86aa for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,528 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/f33d2b9c4bb642cf8e12e56bf0eb458e] hfiles 2023-02-16 06:01:27,528 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/f33d2b9c4bb642cf8e12e56bf0eb458e for snapshot=testWithMapReduceMultiRegion 2023-02-16 06:01:27,543 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. completed. 2023-02-16 06:01:27,543 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:27,543 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 06:01:27,617 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. completed. 2023-02-16 06:01:27,617 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:27,617 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 06:01:27,617 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 06:01:27,617 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,617 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 06:01:27,618 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40759,1676527280787' in zk 2023-02-16 06:01:27,621 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,621 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 06:01:27,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,621 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:27,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:27,621 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 06:01:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40759,1676527280787': 2023-02-16 06:01:27,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40759,1676527280787' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 06:01:27,632 INFO [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-16 06:01:27,632 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:27,632 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:27,632 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-16 06:01:27,632 INFO [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:01:27,643 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,644 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,644 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:27,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,644 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:27,644 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:27,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:27,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,651 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,651 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,654 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:27,654 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 06:01:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:27,668 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:27,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-16 06:01:27,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:27,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:27,668 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:27,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-16 06:01:27,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:27,669 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 06:01:27,669 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 06:01:27,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:27,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:27,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:27,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 06:01:27,718 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:27,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:27,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:27,722 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-16 06:01:27,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-16 06:01:27,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-16 06:01:27,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 06:01:27,783 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 06:01:27,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676527286595Consolidate snapshot: testWithMapReduceMultiRegion at 1676527287669 (+1074 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676527287669Writing data manifest for testWithMapReduceMultiRegion at 1676527287699 (+30 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676527287720 (+21 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676527287782 (+62 ms) 2023-02-16 06:01:27,784 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:01:27,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1870 sec 2023-02-16 06:01:28,153 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-16 06:01:28,233 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 06:01:28,233 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 06:01:28,723 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:28,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:28,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:01:28,725 INFO [Listener at localhost/44557] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:01:28,736 INFO [Listener at localhost/44557] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:01:28,749 INFO [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:01:28,840 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44983] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:28,843 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:28,957 INFO [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:01:28,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:01:28,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 06:01:28,977 INFO [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 06:01:28,977 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:28,978 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 06:01:28,978 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 06:01:28,978 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:28,979 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:28,981 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:28,981 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:28,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:28,981 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:28,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:28,982 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:28,982 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:28,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:28,982 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:28,983 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:28,983 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 06:01:28,985 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 06:01:28,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 06:01:28,986 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 06:01:28,986 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:28,988 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 06:01:28,988 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 06:01:28,989 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:28,989 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 06:01:28,990 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:28,990 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. started... 2023-02-16 06:01:28,990 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 837d6d0fbe7d278bbbfa089acf93e13e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:28,992 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:28,993 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. started... 2023-02-16 06:01:28,993 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing daa01ccb0e487c4292bd567c1978807d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:28,999 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:28,999 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. started... 2023-02-16 06:01:28,999 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:29,000 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 06:01:29,000 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:29,000 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:29,000 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 06:01:29,004 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:29,000 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. started... 2023-02-16 06:01:29,004 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. started... 2023-02-16 06:01:29,005 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7517f88ed11ddd267ae841bdbe7203cc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:29,005 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7d44aedfaba5db72126598bb1839c800 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 06:01:29,004 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:29,004 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:29,008 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. started... 2023-02-16 06:01:29,008 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:29,008 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:29,008 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:29,008 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. started... 2023-02-16 06:01:29,004 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:29,008 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 06:01:29,009 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 61ec816f64cfa470e201b3506a650d01 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 06:01:29,009 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 06:01:29,009 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:29,010 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. started... 2023-02-16 06:01:29,010 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6a0f5ed884463d849746b75f64c0e23f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:29,074 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f1/e2c10b95f8f0447581ef1feb713765bb 2023-02-16 06:01:29,080 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f1/926310ce4ea64008a4ec5f80eb88ef24 2023-02-16 06:01:29,089 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f1/a19f6d27f8614f67ba13d5504a571b34 2023-02-16 06:01:29,097 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f1/19cd1b0de9c4460da56781ecf8732024 2023-02-16 06:01:29,101 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f1/fea2012e2cd845ad997993fba94fbc47 2023-02-16 06:01:29,119 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f1/b0387e6f23994323803d48fa08663a81 2023-02-16 06:01:29,143 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f2/0005dad272bf49f5a818c291d129b2ce 2023-02-16 06:01:29,164 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f2/5d4bfa4b78824ade9fa041c0cb46ee3c 2023-02-16 06:01:29,167 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f1/a19f6d27f8614f67ba13d5504a571b34 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/a19f6d27f8614f67ba13d5504a571b34 2023-02-16 06:01:29,172 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f2/001a047e25b644ff861bb1121b41e261 2023-02-16 06:01:29,174 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f1/19cd1b0de9c4460da56781ecf8732024 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/19cd1b0de9c4460da56781ecf8732024 2023-02-16 06:01:29,178 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/a19f6d27f8614f67ba13d5504a571b34, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,179 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/.tmp/f2/0005dad272bf49f5a818c291d129b2ce as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/0005dad272bf49f5a818c291d129b2ce 2023-02-16 06:01:29,180 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f2/6a74c3fcf57a4d75b146bee20506482a 2023-02-16 06:01:29,182 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/19cd1b0de9c4460da56781ecf8732024, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,184 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/.tmp/f2/5d4bfa4b78824ade9fa041c0cb46ee3c as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/5d4bfa4b78824ade9fa041c0cb46ee3c 2023-02-16 06:01:29,186 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f1/926310ce4ea64008a4ec5f80eb88ef24 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/926310ce4ea64008a4ec5f80eb88ef24 2023-02-16 06:01:29,188 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/0005dad272bf49f5a818c291d129b2ce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,189 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f1/fea2012e2cd845ad997993fba94fbc47 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/fea2012e2cd845ad997993fba94fbc47 2023-02-16 06:01:29,189 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7517f88ed11ddd267ae841bdbe7203cc in 184ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,189 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:29,190 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:29,190 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 06:01:29,190 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:29,190 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. started... 2023-02-16 06:01:29,190 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb309f295384b92b146716a3d868cbc4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:29,192 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/5d4bfa4b78824ade9fa041c0cb46ee3c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,194 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for daa01ccb0e487c4292bd567c1978807d in 200ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,199 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:29,199 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:29,199 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 06:01:29,199 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:29,199 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. started... 2023-02-16 06:01:29,200 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36d3d2895bce6969129ede92f1762122 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:29,201 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/926310ce4ea64008a4ec5f80eb88ef24, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,204 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/.tmp/f2/001a047e25b644ff861bb1121b41e261 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/001a047e25b644ff861bb1121b41e261 2023-02-16 06:01:29,207 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f2/ae04fa9850404bf28432e894fa1a7033 2023-02-16 06:01:29,208 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/fea2012e2cd845ad997993fba94fbc47, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:29,211 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/.tmp/f2/6a74c3fcf57a4d75b146bee20506482a as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/6a74c3fcf57a4d75b146bee20506482a 2023-02-16 06:01:29,217 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/001a047e25b644ff861bb1121b41e261, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,219 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 837d6d0fbe7d278bbbfa089acf93e13e in 229ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,219 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:29,219 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:29,219 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 06:01:29,220 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f1/e2c10b95f8f0447581ef1feb713765bb as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/e2c10b95f8f0447581ef1feb713765bb 2023-02-16 06:01:29,221 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/6a74c3fcf57a4d75b146bee20506482a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:29,222 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7d44aedfaba5db72126598bb1839c800 in 217ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,222 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:29,222 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:29,223 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 06:01:29,236 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f1/ea63bbf982fc4b6f9fd7680275c7fd08 2023-02-16 06:01:29,236 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f1/efd105e14cbb4f7a94f48d0d270ec82c 2023-02-16 06:01:29,237 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/e2c10b95f8f0447581ef1feb713765bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,238 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/.tmp/f2/ae04fa9850404bf28432e894fa1a7033 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/ae04fa9850404bf28432e894fa1a7033 2023-02-16 06:01:29,246 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/ae04fa9850404bf28432e894fa1a7033, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,247 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6a0f5ed884463d849746b75f64c0e23f in 237ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,247 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:29,247 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:29,247 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 06:01:29,256 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f2/f8f48a8035464043b29fa29cbc8529c6 2023-02-16 06:01:29,263 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f1/ea63bbf982fc4b6f9fd7680275c7fd08 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/ea63bbf982fc4b6f9fd7680275c7fd08 2023-02-16 06:01:29,263 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f2/54abb85cdcec41bd8b8850254d6c6285 2023-02-16 06:01:29,269 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/ea63bbf982fc4b6f9fd7680275c7fd08, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,270 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f1/efd105e14cbb4f7a94f48d0d270ec82c as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/efd105e14cbb4f7a94f48d0d270ec82c 2023-02-16 06:01:29,270 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/.tmp/f2/f8f48a8035464043b29fa29cbc8529c6 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/f8f48a8035464043b29fa29cbc8529c6 2023-02-16 06:01:29,276 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/efd105e14cbb4f7a94f48d0d270ec82c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,276 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/f8f48a8035464043b29fa29cbc8529c6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,277 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/.tmp/f2/54abb85cdcec41bd8b8850254d6c6285 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/54abb85cdcec41bd8b8850254d6c6285 2023-02-16 06:01:29,277 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cb309f295384b92b146716a3d868cbc4 in 87ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,277 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:29,277 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:29,277 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 06:01:29,283 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/54abb85cdcec41bd8b8850254d6c6285, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:29,284 INFO [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 36d3d2895bce6969129ede92f1762122 in 84ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,284 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:29,284 DEBUG [rs(jenkins-hbase4.apache.org,40759,1676527280787)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 06:01:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 06:01:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 06:01:29,284 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40759,1676527280787' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 06:01:29,287 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:29,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40759,1676527280787' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 06:01:29,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e0b1075[Count = 1] remaining members to acquire global barrier 2023-02-16 06:01:29,606 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f2/2a03166431eb47aab47f5d8523025f05 2023-02-16 06:01:29,614 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f1/b0387e6f23994323803d48fa08663a81 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/b0387e6f23994323803d48fa08663a81 2023-02-16 06:01:29,621 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/b0387e6f23994323803d48fa08663a81, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:29,622 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/.tmp/f2/2a03166431eb47aab47f5d8523025f05 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/2a03166431eb47aab47f5d8523025f05 2023-02-16 06:01:29,634 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/2a03166431eb47aab47f5d8523025f05, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:29,635 INFO [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 61ec816f64cfa470e201b3506a650d01 in 627ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:29,636 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:29,636 DEBUG [rs(jenkins-hbase4.apache.org,44983,1676527280837)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 06:01:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 06:01:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 06:01:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44983,1676527280837' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 06:01:29,638 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:29,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:29,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:29,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:29,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44983,1676527280837' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 06:01:29,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e0b1075[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:29,641 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 06:01:29,641 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,643 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 06:01:29,643 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 06:01:29,644 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 06:01:29,644 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,644 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 06:01:29,644 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44983,1676527280837' in zk 2023-02-16 06:01:29,644 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40759,1676527280787' in zk 2023-02-16 06:01:29,645 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,645 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:29,647 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,647 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 06:01:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,647 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:29,647 DEBUG [member: 'jenkins-hbase4.apache.org,40759,1676527280787' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 06:01:29,648 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 06:01:29,648 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:29,648 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,648 DEBUG [member: 'jenkins-hbase4.apache.org,44983,1676527280837' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 06:01:29,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:29,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:29,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40759,1676527280787': 2023-02-16 06:01:29,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40759,1676527280787' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 06:01:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:29,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44983,1676527280837': 2023-02-16 06:01:29,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44983,1676527280837' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 06:01:29,658 INFO [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 06:01:29,658 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:29,658 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:29,658 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 06:01:29,658 INFO [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:01:29,661 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,661 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,661 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:29,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,661 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:29,661 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:29,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:29,662 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:29,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:29,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:29,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:29,663 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:29,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,664 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:01:29,665 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 06:01:29,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,667 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,668 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:29,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:29,675 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 06:01:29,674 DEBUG [(jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:29,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:29,674 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:29,675 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:01:29,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:29,675 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:29,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-16 06:01:29,675 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,676 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:29,676 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:29,676 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:29,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:29,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:29,678 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:29,678 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:01:29,778 DEBUG [Listener at localhost/44557] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:01:29,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:01:29,889 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop-7624406396521718193.jar 2023-02-16 06:01:29,907 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676527286546 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:29,908 DEBUG [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce 2023-02-16 06:01:29,908 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(239): region to add: cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=837d6d0fbe7d278bbbfa089acf93e13e as 837d6d0fbe7d278bbbfa089acf93e13e in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,909 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=7517f88ed11ddd267ae841bdbe7203cc as 7517f88ed11ddd267ae841bdbe7203cc in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=daa01ccb0e487c4292bd567c1978807d as daa01ccb0e487c4292bd567c1978807d in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=04887ecd84d8b054339e66cee27da227 as 04887ecd84d8b054339e66cee27da227 in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=ff0137857a747de2bae138ee6b34af0d as ff0137857a747de2bae138ee6b34af0d in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=61ec816f64cfa470e201b3506a650d01 as 61ec816f64cfa470e201b3506a650d01 in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=6a0f5ed884463d849746b75f64c0e23f as 6a0f5ed884463d849746b75f64c0e23f in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=7d44aedfaba5db72126598bb1839c800 as 7d44aedfaba5db72126598bb1839c800 in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=36d3d2895bce6969129ede92f1762122 as 36d3d2895bce6969129ede92f1762122 in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,910 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(585): clone region=cb309f295384b92b146716a3d868cbc4 as cb309f295384b92b146716a3d868cbc4 in snapshot testWithMapReduceMultiRegion 2023-02-16 06:01:29,913 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 837d6d0fbe7d278bbbfa089acf93e13e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,914 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 6a0f5ed884463d849746b75f64c0e23f, NAME => 'testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,915 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ff0137857a747de2bae138ee6b34af0d, NAME => 'testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,915 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 04887ecd84d8b054339e66cee27da227, NAME => 'testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,916 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => daa01ccb0e487c4292bd567c1978807d, NAME => 'testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,916 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7517f88ed11ddd267ae841bdbe7203cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,916 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 61ec816f64cfa470e201b3506a650d01, NAME => 'testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,916 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 7d44aedfaba5db72126598bb1839c800, NAME => 'testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,971 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:29,971 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 04887ecd84d8b054339e66cee27da227, disabling compactions & flushes 2023-02-16 06:01:29,971 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:29,972 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:29,972 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. after waiting 0 ms 2023-02-16 06:01:29,972 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:29,972 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:29,972 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:29,972 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 36d3d2895bce6969129ede92f1762122, NAME => 'testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:29,978 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:29,978 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0048c28175a4ffd8bbe7977e9169b81 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:29,986 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:29,986 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 438d7b012fc9468b967d403ef0a5b71f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:29,987 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:29,988 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b62e4982e9194a958b14614d8994714b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:29,988 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:29,988 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de2ecbc76ba64ef7904b95fa119183a6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:29,990 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:29,990 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d87b8ff2ea2d42a690013e13d0085041 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:29,990 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 961649a0f873402c8bf989fba0a2281c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,000 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3cacec267c17449e907522655aadf0f4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,000 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b0542af961a4677bc535f4f0b9ba22d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,000 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:30,000 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:30,000 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ff0137857a747de2bae138ee6b34af0d, disabling compactions & flushes 2023-02-16 06:01:30,000 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74b00ff0000f4da6a7651e7eedbb86aa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,000 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:30,001 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:30,001 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. after waiting 0 ms 2023-02-16 06:01:30,001 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:30,001 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:30,001 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:30,001 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => cb309f295384b92b146716a3d868cbc4, NAME => 'testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:30,004 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 945ad72fdae949d7a6664457710f67cf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,004 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 44cae266b8b4413487b90c06a9db9e19 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 837d6d0fbe7d278bbbfa089acf93e13e, disabling compactions & flushes 2023-02-16 06:01:30,005 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:30,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:30,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. after waiting 0 ms 2023-02-16 06:01:30,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:30,005 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:30,005 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:30,008 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f33d2b9c4bb642cf8e12e56bf0eb458e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,008 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:30,008 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 47026243d95c48189a54f6f76e465dec from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 61ec816f64cfa470e201b3506a650d01, disabling compactions & flushes 2023-02-16 06:01:30,011 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. after waiting 0 ms 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:30,011 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7517f88ed11ddd267ae841bdbe7203cc, disabling compactions & flushes 2023-02-16 06:01:30,011 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. after waiting 0 ms 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:30,011 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:30,011 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 6a0f5ed884463d849746b75f64c0e23f, disabling compactions & flushes 2023-02-16 06:01:30,012 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. after waiting 0 ms 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:30,012 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing daa01ccb0e487c4292bd567c1978807d, disabling compactions & flushes 2023-02-16 06:01:30,012 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. after waiting 0 ms 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 7d44aedfaba5db72126598bb1839c800, disabling compactions & flushes 2023-02-16 06:01:30,012 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:30,012 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:30,013 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:30,013 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. after waiting 0 ms 2023-02-16 06:01:30,013 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:30,013 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:30,013 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:30,013 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b1a33df8bdea4220b1d6849e3f9bcd22 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,013 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:30,020 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:30,020 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9d2966c4f9c745708cb9d7b86fdb045a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,020 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 36d3d2895bce6969129ede92f1762122, disabling compactions & flushes 2023-02-16 06:01:30,021 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:30,021 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:30,021 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. after waiting 0 ms 2023-02-16 06:01:30,021 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:30,021 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:30,021 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:30,023 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d18fcc3ada64a4ab5709034a1e06b8d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 06:01:30,025 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing cb309f295384b92b146716a3d868cbc4, disabling compactions & flushes 2023-02-16 06:01:30,026 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:30,026 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:30,026 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. after waiting 0 ms 2023-02-16 06:01:30,026 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:30,026 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:30,026 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:30,026 INFO [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676527286546 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:30,026 DEBUG [Listener at localhost/44557] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:30,026 DEBUG [Listener at localhost/44557] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29 2023-02-16 06:01:30,027 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-data/ 2023-02-16 06:01:30,028 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----default/ 2023-02-16 06:01:30,028 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 06:01:30,029 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------04887ecd84d8b054339e66cee27da227/ 2023-02-16 06:01:30,029 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,029 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------36d3d2895bce6969129ede92f1762122/ 2023-02-16 06:01:30,030 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,030 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,030 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=36d3d2895bce6969129ede92f1762122-47026243d95c48189a54f6f76e465dec 2023-02-16 06:01:30,030 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,031 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=36d3d2895bce6969129ede92f1762122-b1a33df8bdea4220b1d6849e3f9bcd22 2023-02-16 06:01:30,031 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------61ec816f64cfa470e201b3506a650d01/ 2023-02-16 06:01:30,031 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,032 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,032 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=61ec816f64cfa470e201b3506a650d01-de2ecbc76ba64ef7904b95fa119183a6 2023-02-16 06:01:30,032 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,033 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=61ec816f64cfa470e201b3506a650d01-945ad72fdae949d7a6664457710f67cf 2023-02-16 06:01:30,033 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------6a0f5ed884463d849746b75f64c0e23f/ 2023-02-16 06:01:30,033 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,033 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,034 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=6a0f5ed884463d849746b75f64c0e23f-961649a0f873402c8bf989fba0a2281c 2023-02-16 06:01:30,034 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,034 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=6a0f5ed884463d849746b75f64c0e23f-44cae266b8b4413487b90c06a9db9e19 2023-02-16 06:01:30,034 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------7517f88ed11ddd267ae841bdbe7203cc/ 2023-02-16 06:01:30,035 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,035 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,036 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=7517f88ed11ddd267ae841bdbe7203cc-438d7b012fc9468b967d403ef0a5b71f 2023-02-16 06:01:30,036 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,037 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=7517f88ed11ddd267ae841bdbe7203cc-1b0542af961a4677bc535f4f0b9ba22d 2023-02-16 06:01:30,037 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------7d44aedfaba5db72126598bb1839c800/ 2023-02-16 06:01:30,037 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,037 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,038 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=7d44aedfaba5db72126598bb1839c800-74b00ff0000f4da6a7651e7eedbb86aa 2023-02-16 06:01:30,038 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,038 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=7d44aedfaba5db72126598bb1839c800-f33d2b9c4bb642cf8e12e56bf0eb458e 2023-02-16 06:01:30,038 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------837d6d0fbe7d278bbbfa089acf93e13e/ 2023-02-16 06:01:30,039 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,039 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,040 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=837d6d0fbe7d278bbbfa089acf93e13e-a0048c28175a4ffd8bbe7977e9169b81 2023-02-16 06:01:30,040 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,040 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=837d6d0fbe7d278bbbfa089acf93e13e-d87b8ff2ea2d42a690013e13d0085041 2023-02-16 06:01:30,040 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------cb309f295384b92b146716a3d868cbc4/ 2023-02-16 06:01:30,041 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,041 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,042 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=cb309f295384b92b146716a3d868cbc4-9d2966c4f9c745708cb9d7b86fdb045a 2023-02-16 06:01:30,042 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,042 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=cb309f295384b92b146716a3d868cbc4-5d18fcc3ada64a4ab5709034a1e06b8d 2023-02-16 06:01:30,042 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------daa01ccb0e487c4292bd567c1978807d/ 2023-02-16 06:01:30,043 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,043 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:30,043 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=daa01ccb0e487c4292bd567c1978807d-b62e4982e9194a958b14614d8994714b 2023-02-16 06:01:30,043 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:30,044 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |----------------testWithMapReduce=daa01ccb0e487c4292bd567c1978807d-3cacec267c17449e907522655aadf0f4 2023-02-16 06:01:30,044 DEBUG [Listener at localhost/44557] util.CommonFSUtils(699): |----------ff0137857a747de2bae138ee6b34af0d/ 2023-02-16 06:01:30,044 DEBUG [Listener at localhost/44557] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:30,052 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:30,053 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:30,053 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:30,054 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,030 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop-6961911848556481960.jar 2023-02-16 06:01:31,031 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,031 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,099 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop-248501507559009134.jar 2023-02-16 06:01:31,100 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,100 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,100 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,101 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,101 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,102 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,102 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 06:01:31,103 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 06:01:31,103 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 06:01:31,104 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 06:01:31,104 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 06:01:31,105 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 06:01:31,105 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 06:01:31,105 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 06:01:31,106 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 06:01:31,106 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 06:01:31,112 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:31,113 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:01:31,113 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:01:31,114 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:01:31,114 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 06:01:31,189 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop-1876391838323534292.jar 2023-02-16 06:01:31,190 DEBUG [Listener at localhost/44557] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 06:01:31,240 WARN [Listener at localhost/44557] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 06:01:31,253 WARN [Listener at localhost/44557] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 06:01:31,271 INFO [Listener at localhost/44557] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 06:01:31,658 WARN [Listener at localhost/44557] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/mapreduce.cluster.local.dir/1676527291572/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 06:01:31,658 WARN [Listener at localhost/44557] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/mapreduce.cluster.local.dir/1676527291572/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 06:01:31,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:31,839 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:31,841 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:31,843 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:31,845 DEBUG [StoreOpener-04887ecd84d8b054339e66cee27da227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f1 2023-02-16 06:01:31,846 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04887ecd84d8b054339e66cee27da227 columnFamilyName f1 2023-02-16 06:01:31,846 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(310): Store=04887ecd84d8b054339e66cee27da227/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:31,847 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:31,848 DEBUG [StoreOpener-04887ecd84d8b054339e66cee27da227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f2 2023-02-16 06:01:31,848 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04887ecd84d8b054339e66cee27da227 columnFamilyName f2 2023-02-16 06:01:31,849 INFO [StoreOpener-04887ecd84d8b054339e66cee27da227-1] regionserver.HStore(310): Store=04887ecd84d8b054339e66cee27da227/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:31,849 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:31,849 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 04887ecd84d8b054339e66cee27da227; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63770503, jitterRate=-0.049745455384254456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:31,850 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:31,891 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 04887ecd84d8b054339e66cee27da227, disabling compactions & flushes 2023-02-16 06:01:31,892 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:31,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:31,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. after waiting 0 ms 2023-02-16 06:01:31,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:31,892 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:31,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:31,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:31,907 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:31,908 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:31,911 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:31,912 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1 2023-02-16 06:01:31,912 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb309f295384b92b146716a3d868cbc4 columnFamilyName f1 2023-02-16 06:01:31,921 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/testWithMapReduce=cb309f295384b92b146716a3d868cbc4-9d2966c4f9c745708cb9d7b86fdb045a 2023-02-16 06:01:31,922 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(310): Store=cb309f295384b92b146716a3d868cbc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:31,922 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:31,923 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2 2023-02-16 06:01:31,924 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb309f295384b92b146716a3d868cbc4 columnFamilyName f2 2023-02-16 06:01:31,930 DEBUG [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/testWithMapReduce=cb309f295384b92b146716a3d868cbc4-5d18fcc3ada64a4ab5709034a1e06b8d 2023-02-16 06:01:31,930 INFO [StoreOpener-cb309f295384b92b146716a3d868cbc4-1] regionserver.HStore(310): Store=cb309f295384b92b146716a3d868cbc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:31,931 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:31,931 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cb309f295384b92b146716a3d868cbc4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67199211, jitterRate=0.0013462752103805542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:31,931 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:32,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cb309f295384b92b146716a3d868cbc4, disabling compactions & flushes 2023-02-16 06:01:32,119 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:32,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:32,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. after waiting 0 ms 2023-02-16 06:01:32,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:32,129 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:32,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:32,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,135 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,140 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,144 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:32,146 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1 2023-02-16 06:01:32,146 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 837d6d0fbe7d278bbbfa089acf93e13e columnFamilyName f1 2023-02-16 06:01:32,154 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/testWithMapReduce=837d6d0fbe7d278bbbfa089acf93e13e-a0048c28175a4ffd8bbe7977e9169b81 2023-02-16 06:01:32,154 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(310): Store=837d6d0fbe7d278bbbfa089acf93e13e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,154 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:32,155 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2 2023-02-16 06:01:32,156 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 837d6d0fbe7d278bbbfa089acf93e13e columnFamilyName f2 2023-02-16 06:01:32,165 DEBUG [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/testWithMapReduce=837d6d0fbe7d278bbbfa089acf93e13e-d87b8ff2ea2d42a690013e13d0085041 2023-02-16 06:01:32,165 INFO [StoreOpener-837d6d0fbe7d278bbbfa089acf93e13e-1] regionserver.HStore(310): Store=837d6d0fbe7d278bbbfa089acf93e13e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,165 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 837d6d0fbe7d278bbbfa089acf93e13e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69947714, jitterRate=0.04230216145515442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:32,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 837d6d0fbe7d278bbbfa089acf93e13e, disabling compactions & flushes 2023-02-16 06:01:32,290 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:32,290 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:32,290 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. after waiting 0 ms 2023-02-16 06:01:32,290 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:32,293 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:32,294 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:32,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,312 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,318 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,320 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:32,322 DEBUG [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f1 2023-02-16 06:01:32,323 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff0137857a747de2bae138ee6b34af0d columnFamilyName f1 2023-02-16 06:01:32,323 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(310): Store=ff0137857a747de2bae138ee6b34af0d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,324 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:32,325 DEBUG [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f2 2023-02-16 06:01:32,326 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff0137857a747de2bae138ee6b34af0d columnFamilyName f2 2023-02-16 06:01:32,326 INFO [StoreOpener-ff0137857a747de2bae138ee6b34af0d-1] regionserver.HStore(310): Store=ff0137857a747de2bae138ee6b34af0d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ff0137857a747de2bae138ee6b34af0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60858085, jitterRate=-0.09314386546611786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:32,344 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ff0137857a747de2bae138ee6b34af0d, disabling compactions & flushes 2023-02-16 06:01:32,344 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:32,344 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:32,344 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. after waiting 0 ms 2023-02-16 06:01:32,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:32,345 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:32,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:32,349 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,349 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,350 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,353 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:32,354 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1 2023-02-16 06:01:32,354 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f5ed884463d849746b75f64c0e23f columnFamilyName f1 2023-02-16 06:01:32,362 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/testWithMapReduce=6a0f5ed884463d849746b75f64c0e23f-961649a0f873402c8bf989fba0a2281c 2023-02-16 06:01:32,362 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(310): Store=6a0f5ed884463d849746b75f64c0e23f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,362 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:32,364 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2 2023-02-16 06:01:32,364 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a0f5ed884463d849746b75f64c0e23f columnFamilyName f2 2023-02-16 06:01:32,373 DEBUG [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/testWithMapReduce=6a0f5ed884463d849746b75f64c0e23f-44cae266b8b4413487b90c06a9db9e19 2023-02-16 06:01:32,373 INFO [StoreOpener-6a0f5ed884463d849746b75f64c0e23f-1] regionserver.HStore(310): Store=6a0f5ed884463d849746b75f64c0e23f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,374 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6a0f5ed884463d849746b75f64c0e23f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66402003, jitterRate=-0.010533049702644348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,374 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:32,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6a0f5ed884463d849746b75f64c0e23f, disabling compactions & flushes 2023-02-16 06:01:32,437 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:32,438 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:32,438 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. after waiting 0 ms 2023-02-16 06:01:32,438 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:32,440 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:32,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:32,445 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,445 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,452 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,454 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:32,455 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1 2023-02-16 06:01:32,456 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d44aedfaba5db72126598bb1839c800 columnFamilyName f1 2023-02-16 06:01:32,462 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/testWithMapReduce=7d44aedfaba5db72126598bb1839c800-74b00ff0000f4da6a7651e7eedbb86aa 2023-02-16 06:01:32,462 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(310): Store=7d44aedfaba5db72126598bb1839c800/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,462 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:32,463 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2 2023-02-16 06:01:32,464 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d44aedfaba5db72126598bb1839c800 columnFamilyName f2 2023-02-16 06:01:32,474 DEBUG [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/testWithMapReduce=7d44aedfaba5db72126598bb1839c800-f33d2b9c4bb642cf8e12e56bf0eb458e 2023-02-16 06:01:32,474 INFO [StoreOpener-7d44aedfaba5db72126598bb1839c800-1] regionserver.HStore(310): Store=7d44aedfaba5db72126598bb1839c800/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,475 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,475 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7d44aedfaba5db72126598bb1839c800; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74147671, jitterRate=0.10488639771938324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,475 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:32,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7d44aedfaba5db72126598bb1839c800, disabling compactions & flushes 2023-02-16 06:01:32,538 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:32,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:32,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. after waiting 0 ms 2023-02-16 06:01:32,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:32,544 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:32,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:32,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,550 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,553 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,560 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:32,562 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1 2023-02-16 06:01:32,562 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daa01ccb0e487c4292bd567c1978807d columnFamilyName f1 2023-02-16 06:01:32,570 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/testWithMapReduce=daa01ccb0e487c4292bd567c1978807d-b62e4982e9194a958b14614d8994714b 2023-02-16 06:01:32,570 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(310): Store=daa01ccb0e487c4292bd567c1978807d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,570 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:32,572 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2 2023-02-16 06:01:32,572 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daa01ccb0e487c4292bd567c1978807d columnFamilyName f2 2023-02-16 06:01:32,583 DEBUG [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/testWithMapReduce=daa01ccb0e487c4292bd567c1978807d-3cacec267c17449e907522655aadf0f4 2023-02-16 06:01:32,583 INFO [StoreOpener-daa01ccb0e487c4292bd567c1978807d-1] regionserver.HStore(310): Store=daa01ccb0e487c4292bd567c1978807d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,584 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,584 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened daa01ccb0e487c4292bd567c1978807d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60029043, jitterRate=-0.10549755394458771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,584 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:32,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing daa01ccb0e487c4292bd567c1978807d, disabling compactions & flushes 2023-02-16 06:01:32,679 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:32,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:32,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. after waiting 0 ms 2023-02-16 06:01:32,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:32,686 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:32,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:32,691 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,691 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,700 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,703 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:32,708 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1 2023-02-16 06:01:32,709 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7517f88ed11ddd267ae841bdbe7203cc columnFamilyName f1 2023-02-16 06:01:32,725 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/testWithMapReduce=7517f88ed11ddd267ae841bdbe7203cc-438d7b012fc9468b967d403ef0a5b71f 2023-02-16 06:01:32,725 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(310): Store=7517f88ed11ddd267ae841bdbe7203cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,725 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:32,726 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2 2023-02-16 06:01:32,727 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7517f88ed11ddd267ae841bdbe7203cc columnFamilyName f2 2023-02-16 06:01:32,738 DEBUG [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/testWithMapReduce=7517f88ed11ddd267ae841bdbe7203cc-1b0542af961a4677bc535f4f0b9ba22d 2023-02-16 06:01:32,738 INFO [StoreOpener-7517f88ed11ddd267ae841bdbe7203cc-1] regionserver.HStore(310): Store=7517f88ed11ddd267ae841bdbe7203cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,739 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,739 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7517f88ed11ddd267ae841bdbe7203cc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68486231, jitterRate=0.020524367690086365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,739 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:32,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7517f88ed11ddd267ae841bdbe7203cc, disabling compactions & flushes 2023-02-16 06:01:32,785 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:32,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:32,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. after waiting 0 ms 2023-02-16 06:01:32,786 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:32,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:32,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:32,796 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,797 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,800 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,805 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:32,806 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1 2023-02-16 06:01:32,806 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36d3d2895bce6969129ede92f1762122 columnFamilyName f1 2023-02-16 06:01:32,829 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/testWithMapReduce=36d3d2895bce6969129ede92f1762122-47026243d95c48189a54f6f76e465dec 2023-02-16 06:01:32,829 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(310): Store=36d3d2895bce6969129ede92f1762122/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,829 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:32,831 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2 2023-02-16 06:01:32,831 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36d3d2895bce6969129ede92f1762122 columnFamilyName f2 2023-02-16 06:01:32,838 DEBUG [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/testWithMapReduce=36d3d2895bce6969129ede92f1762122-b1a33df8bdea4220b1d6849e3f9bcd22 2023-02-16 06:01:32,838 INFO [StoreOpener-36d3d2895bce6969129ede92f1762122-1] regionserver.HStore(310): Store=36d3d2895bce6969129ede92f1762122/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,838 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 36d3d2895bce6969129ede92f1762122; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61987761, jitterRate=-0.07631038129329681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:32,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 36d3d2895bce6969129ede92f1762122, disabling compactions & flushes 2023-02-16 06:01:32,877 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:32,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:32,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. after waiting 0 ms 2023-02-16 06:01:32,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:32,880 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:32,880 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:32,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:32,884 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:32,890 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:32,892 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:32,893 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1 2023-02-16 06:01:32,893 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61ec816f64cfa470e201b3506a650d01 columnFamilyName f1 2023-02-16 06:01:32,901 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/testWithMapReduce=61ec816f64cfa470e201b3506a650d01-de2ecbc76ba64ef7904b95fa119183a6 2023-02-16 06:01:32,901 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(310): Store=61ec816f64cfa470e201b3506a650d01/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,901 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:32,902 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2 2023-02-16 06:01:32,903 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61ec816f64cfa470e201b3506a650d01 columnFamilyName f2 2023-02-16 06:01:32,909 DEBUG [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(539): loaded hdfs://localhost:32817/user/jenkins/test-data/e546e193-98b5-7e28-9f27-dc65d1e0d8b5/testWithMapReduceMultiRegion/629611fb-9128-4dab-bc2e-37a67046ba29/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/testWithMapReduce=61ec816f64cfa470e201b3506a650d01-945ad72fdae949d7a6664457710f67cf 2023-02-16 06:01:32,909 INFO [StoreOpener-61ec816f64cfa470e201b3506a650d01-1] regionserver.HStore(310): Store=61ec816f64cfa470e201b3506a650d01/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:32,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:32,910 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 61ec816f64cfa470e201b3506a650d01; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71631776, jitterRate=0.06739664077758789}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:32,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:32,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 61ec816f64cfa470e201b3506a650d01, disabling compactions & flushes 2023-02-16 06:01:32,949 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:32,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:32,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. after waiting 0 ms 2023-02-16 06:01:32,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:32,955 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:32,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:33,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-16 06:01:33,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-16 06:01:33,770 INFO [Listener at localhost/44557] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 06:01:33,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 06:01:33,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 06:01:33,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527293781"}]},"ts":"1676527293781"} 2023-02-16 06:01:33,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:33,783 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 06:01:33,786 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 06:01:33,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, UNASSIGN}] 2023-02-16 06:01:33,793 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, UNASSIGN 2023-02-16 06:01:33,794 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, UNASSIGN 2023-02-16 06:01:33,795 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, UNASSIGN 2023-02-16 06:01:33,795 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, UNASSIGN 2023-02-16 06:01:33,795 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, UNASSIGN 2023-02-16 06:01:33,797 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ff0137857a747de2bae138ee6b34af0d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:33,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527293797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293797"}]},"ts":"1676527293797"} 2023-02-16 06:01:33,800 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=cb309f295384b92b146716a3d868cbc4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:33,800 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6a0f5ed884463d849746b75f64c0e23f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:33,800 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293800"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293800"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293800"}]},"ts":"1676527293800"} 2023-02-16 06:01:33,800 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293800"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293800"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293800"}]},"ts":"1676527293800"} 2023-02-16 06:01:33,801 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=61ec816f64cfa470e201b3506a650d01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:33,801 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=36d3d2895bce6969129ede92f1762122, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:33,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293801"}]},"ts":"1676527293801"} 2023-02-16 06:01:33,802 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676527283797.36d3d2895bce6969129ede92f1762122.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293801"}]},"ts":"1676527293801"} 2023-02-16 06:01:33,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure ff0137857a747de2bae138ee6b34af0d, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:33,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure cb309f295384b92b146716a3d868cbc4, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:33,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure 6a0f5ed884463d849746b75f64c0e23f, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:33,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure 61ec816f64cfa470e201b3506a650d01, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:33,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 36d3d2895bce6969129ede92f1762122, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:33,813 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, UNASSIGN 2023-02-16 06:01:33,814 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, UNASSIGN 2023-02-16 06:01:33,814 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7517f88ed11ddd267ae841bdbe7203cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:33,814 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, UNASSIGN 2023-02-16 06:01:33,814 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293814"}]},"ts":"1676527293814"} 2023-02-16 06:01:33,814 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, UNASSIGN 2023-02-16 06:01:33,815 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, UNASSIGN 2023-02-16 06:01:33,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=837d6d0fbe7d278bbbfa089acf93e13e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:33,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293815"}]},"ts":"1676527293815"} 2023-02-16 06:01:33,816 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=daa01ccb0e487c4292bd567c1978807d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:33,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=04887ecd84d8b054339e66cee27da227, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:33,816 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293816"}]},"ts":"1676527293816"} 2023-02-16 06:01:33,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527293816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293816"}]},"ts":"1676527293816"} 2023-02-16 06:01:33,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=7d44aedfaba5db72126598bb1839c800, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:33,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527293817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527293817"}]},"ts":"1676527293817"} 2023-02-16 06:01:33,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 7517f88ed11ddd267ae841bdbe7203cc, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:33,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 837d6d0fbe7d278bbbfa089acf93e13e, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:33,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure daa01ccb0e487c4292bd567c1978807d, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:33,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure 04887ecd84d8b054339e66cee27da227, server=jenkins-hbase4.apache.org,44983,1676527280837}] 2023-02-16 06:01:33,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=35, state=RUNNABLE; CloseRegionProcedure 7d44aedfaba5db72126598bb1839c800, server=jenkins-hbase4.apache.org,40759,1676527280787}] 2023-02-16 06:01:33,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:33,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:33,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:33,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 837d6d0fbe7d278bbbfa089acf93e13e, disabling compactions & flushes 2023-02-16 06:01:33,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7d44aedfaba5db72126598bb1839c800, disabling compactions & flushes 2023-02-16 06:01:33,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:33,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. after waiting 0 ms 2023-02-16 06:01:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. after waiting 0 ms 2023-02-16 06:01:33,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:33,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:33,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800. 2023-02-16 06:01:33,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7d44aedfaba5db72126598bb1839c800: 2023-02-16 06:01:33,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e. 2023-02-16 06:01:33,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 837d6d0fbe7d278bbbfa089acf93e13e: 2023-02-16 06:01:33,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:33,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:33,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff0137857a747de2bae138ee6b34af0d, disabling compactions & flushes 2023-02-16 06:01:33,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:33,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:33,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. after waiting 0 ms 2023-02-16 06:01:33,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:33,981 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=7d44aedfaba5db72126598bb1839c800, regionState=CLOSED 2023-02-16 06:01:33,982 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527293981"}]},"ts":"1676527293981"} 2023-02-16 06:01:33,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:33,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb309f295384b92b146716a3d868cbc4, disabling compactions & flushes 2023-02-16 06:01:33,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. after waiting 0 ms 2023-02-16 06:01:33,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:33,988 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=837d6d0fbe7d278bbbfa089acf93e13e, regionState=CLOSED 2023-02-16 06:01:33,988 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527293988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527293988"}]},"ts":"1676527293988"} 2023-02-16 06:01:33,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=35 2023-02-16 06:01:33,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=35, state=SUCCESS; CloseRegionProcedure 7d44aedfaba5db72126598bb1839c800, server=jenkins-hbase4.apache.org,40759,1676527280787 in 166 msec 2023-02-16 06:01:33,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 06:01:33,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:33,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-16 06:01:33,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 837d6d0fbe7d278bbbfa089acf93e13e, server=jenkins-hbase4.apache.org,44983,1676527280837 in 174 msec 2023-02-16 06:01:33,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d44aedfaba5db72126598bb1839c800, UNASSIGN in 207 msec 2023-02-16 06:01:33,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d. 2023-02-16 06:01:33,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff0137857a747de2bae138ee6b34af0d: 2023-02-16 06:01:33,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=837d6d0fbe7d278bbbfa089acf93e13e, UNASSIGN in 208 msec 2023-02-16 06:01:33,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4. 2023-02-16 06:01:33,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb309f295384b92b146716a3d868cbc4: 2023-02-16 06:01:33,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:33,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:33,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing daa01ccb0e487c4292bd567c1978807d, disabling compactions & flushes 2023-02-16 06:01:34,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:34,000 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ff0137857a747de2bae138ee6b34af0d, regionState=CLOSED 2023-02-16 06:01:34,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:34,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. after waiting 0 ms 2023-02-16 06:01:34,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:34,000 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527294000"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294000"}]},"ts":"1676527294000"} 2023-02-16 06:01:34,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:34,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:34,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 61ec816f64cfa470e201b3506a650d01, disabling compactions & flushes 2023-02-16 06:01:34,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:34,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:34,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. after waiting 0 ms 2023-02-16 06:01:34,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:34,001 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=cb309f295384b92b146716a3d868cbc4, regionState=CLOSED 2023-02-16 06:01:34,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527294001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294001"}]},"ts":"1676527294001"} 2023-02-16 06:01:34,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-16 06:01:34,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure cb309f295384b92b146716a3d868cbc4, server=jenkins-hbase4.apache.org,44983,1676527280837 in 199 msec 2023-02-16 06:01:34,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb309f295384b92b146716a3d868cbc4, UNASSIGN in 225 msec 2023-02-16 06:01:34,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-16 06:01:34,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure ff0137857a747de2bae138ee6b34af0d, server=jenkins-hbase4.apache.org,40759,1676527280787 in 200 msec 2023-02-16 06:01:34,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ff0137857a747de2bae138ee6b34af0d, UNASSIGN in 229 msec 2023-02-16 06:01:34,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:34,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d. 2023-02-16 06:01:34,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for daa01ccb0e487c4292bd567c1978807d: 2023-02-16 06:01:34,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:34,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:34,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a0f5ed884463d849746b75f64c0e23f, disabling compactions & flushes 2023-02-16 06:01:34,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:34,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:34,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. after waiting 0 ms 2023-02-16 06:01:34,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:34,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:34,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01. 2023-02-16 06:01:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 61ec816f64cfa470e201b3506a650d01: 2023-02-16 06:01:34,041 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=daa01ccb0e487c4292bd567c1978807d, regionState=CLOSED 2023-02-16 06:01:34,041 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527294041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294041"}]},"ts":"1676527294041"} 2023-02-16 06:01:34,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:34,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:34,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 04887ecd84d8b054339e66cee27da227, disabling compactions & flushes 2023-02-16 06:01:34,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:34,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:34,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. after waiting 0 ms 2023-02-16 06:01:34,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:34,044 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=61ec816f64cfa470e201b3506a650d01, regionState=CLOSED 2023-02-16 06:01:34,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527294044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294044"}]},"ts":"1676527294044"} 2023-02-16 06:01:34,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:34,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f. 2023-02-16 06:01:34,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a0f5ed884463d849746b75f64c0e23f: 2023-02-16 06:01:34,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-16 06:01:34,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure daa01ccb0e487c4292bd567c1978807d, server=jenkins-hbase4.apache.org,40759,1676527280787 in 224 msec 2023-02-16 06:01:34,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:34,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 06:01:34,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:34,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 36d3d2895bce6969129ede92f1762122, disabling compactions & flushes 2023-02-16 06:01:34,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:34,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:34,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. after waiting 0 ms 2023-02-16 06:01:34,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:34,054 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6a0f5ed884463d849746b75f64c0e23f, regionState=CLOSED 2023-02-16 06:01:34,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-16 06:01:34,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure 61ec816f64cfa470e201b3506a650d01, server=jenkins-hbase4.apache.org,44983,1676527280837 in 242 msec 2023-02-16 06:01:34,054 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527294054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294054"}]},"ts":"1676527294054"} 2023-02-16 06:01:34,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=daa01ccb0e487c4292bd567c1978807d, UNASSIGN in 264 msec 2023-02-16 06:01:34,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=61ec816f64cfa470e201b3506a650d01, UNASSIGN in 264 msec 2023-02-16 06:01:34,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227. 2023-02-16 06:01:34,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 04887ecd84d8b054339e66cee27da227: 2023-02-16 06:01:34,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-16 06:01:34,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure 6a0f5ed884463d849746b75f64c0e23f, server=jenkins-hbase4.apache.org,40759,1676527280787 in 253 msec 2023-02-16 06:01:34,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:34,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:34,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7517f88ed11ddd267ae841bdbe7203cc, disabling compactions & flushes 2023-02-16 06:01:34,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:34,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:34,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. after waiting 0 ms 2023-02-16 06:01:34,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:34,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6a0f5ed884463d849746b75f64c0e23f, UNASSIGN in 277 msec 2023-02-16 06:01:34,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=04887ecd84d8b054339e66cee27da227, regionState=CLOSED 2023-02-16 06:01:34,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527294068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294068"}]},"ts":"1676527294068"} 2023-02-16 06:01:34,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-16 06:01:34,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure 04887ecd84d8b054339e66cee27da227, server=jenkins-hbase4.apache.org,44983,1676527280837 in 249 msec 2023-02-16 06:01:34,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=04887ecd84d8b054339e66cee27da227, UNASSIGN in 287 msec 2023-02-16 06:01:34,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:34,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:34,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122. 2023-02-16 06:01:34,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 36d3d2895bce6969129ede92f1762122: 2023-02-16 06:01:34,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:34,093 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=36d3d2895bce6969129ede92f1762122, regionState=CLOSED 2023-02-16 06:01:34,094 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676527283797.36d3d2895bce6969129ede92f1762122.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527294093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294093"}]},"ts":"1676527294093"} 2023-02-16 06:01:34,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-16 06:01:34,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 36d3d2895bce6969129ede92f1762122, server=jenkins-hbase4.apache.org,40759,1676527280787 in 289 msec 2023-02-16 06:01:34,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=36d3d2895bce6969129ede92f1762122, UNASSIGN in 312 msec 2023-02-16 06:01:34,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:34,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc. 2023-02-16 06:01:34,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7517f88ed11ddd267ae841bdbe7203cc: 2023-02-16 06:01:34,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:34,109 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7517f88ed11ddd267ae841bdbe7203cc, regionState=CLOSED 2023-02-16 06:01:34,110 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527294109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527294109"}]},"ts":"1676527294109"} 2023-02-16 06:01:34,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-16 06:01:34,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 7517f88ed11ddd267ae841bdbe7203cc, server=jenkins-hbase4.apache.org,44983,1676527280837 in 293 msec 2023-02-16 06:01:34,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-16 06:01:34,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7517f88ed11ddd267ae841bdbe7203cc, UNASSIGN in 326 msec 2023-02-16 06:01:34,117 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527294117"}]},"ts":"1676527294117"} 2023-02-16 06:01:34,119 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 06:01:34,122 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 06:01:34,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 351 msec 2023-02-16 06:01:34,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:34,388 INFO [Listener at localhost/44557] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-16 06:01:34,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 06:01:34,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:01:34,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:01:34,405 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:01:34,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:34,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:34,435 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/recovered.edits] 2023-02-16 06:01:34,436 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/recovered.edits] 2023-02-16 06:01:34,436 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/recovered.edits] 2023-02-16 06:01:34,436 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/recovered.edits] 2023-02-16 06:01:34,437 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/recovered.edits] 2023-02-16 06:01:34,437 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/recovered.edits] 2023-02-16 06:01:34,438 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/recovered.edits] 2023-02-16 06:01:34,438 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/recovered.edits] 2023-02-16 06:01:34,453 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/438d7b012fc9468b967d403ef0a5b71f to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/438d7b012fc9468b967d403ef0a5b71f 2023-02-16 06:01:34,453 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/47026243d95c48189a54f6f76e465dec to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/47026243d95c48189a54f6f76e465dec 2023-02-16 06:01:34,453 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/961649a0f873402c8bf989fba0a2281c to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/961649a0f873402c8bf989fba0a2281c 2023-02-16 06:01:34,454 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/926310ce4ea64008a4ec5f80eb88ef24 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/926310ce4ea64008a4ec5f80eb88ef24 2023-02-16 06:01:34,456 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/74b00ff0000f4da6a7651e7eedbb86aa to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/74b00ff0000f4da6a7651e7eedbb86aa 2023-02-16 06:01:34,456 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/9d2966c4f9c745708cb9d7b86fdb045a to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/9d2966c4f9c745708cb9d7b86fdb045a 2023-02-16 06:01:34,456 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/19cd1b0de9c4460da56781ecf8732024 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/19cd1b0de9c4460da56781ecf8732024 2023-02-16 06:01:34,458 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/efd105e14cbb4f7a94f48d0d270ec82c to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f1/efd105e14cbb4f7a94f48d0d270ec82c 2023-02-16 06:01:34,458 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/a19f6d27f8614f67ba13d5504a571b34 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f1/a19f6d27f8614f67ba13d5504a571b34 2023-02-16 06:01:34,459 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/e2c10b95f8f0447581ef1feb713765bb to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f1/e2c10b95f8f0447581ef1feb713765bb 2023-02-16 06:01:34,459 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/a0048c28175a4ffd8bbe7977e9169b81 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f1/a0048c28175a4ffd8bbe7977e9169b81 2023-02-16 06:01:34,460 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/recovered.edits/6.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227/recovered.edits/6.seqid 2023-02-16 06:01:34,460 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/fea2012e2cd845ad997993fba94fbc47 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f1/fea2012e2cd845ad997993fba94fbc47 2023-02-16 06:01:34,460 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/b62e4982e9194a958b14614d8994714b to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f1/b62e4982e9194a958b14614d8994714b 2023-02-16 06:01:34,461 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/ea63bbf982fc4b6f9fd7680275c7fd08 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f1/ea63bbf982fc4b6f9fd7680275c7fd08 2023-02-16 06:01:34,461 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/04887ecd84d8b054339e66cee27da227 2023-02-16 06:01:34,461 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:34,473 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/5d18fcc3ada64a4ab5709034a1e06b8d to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/5d18fcc3ada64a4ab5709034a1e06b8d 2023-02-16 06:01:34,474 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/0005dad272bf49f5a818c291d129b2ce to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/0005dad272bf49f5a818c291d129b2ce 2023-02-16 06:01:34,474 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/recovered.edits] 2023-02-16 06:01:34,474 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/3cacec267c17449e907522655aadf0f4 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/3cacec267c17449e907522655aadf0f4 2023-02-16 06:01:34,474 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/44cae266b8b4413487b90c06a9db9e19 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/44cae266b8b4413487b90c06a9db9e19 2023-02-16 06:01:34,475 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/001a047e25b644ff861bb1121b41e261 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/001a047e25b644ff861bb1121b41e261 2023-02-16 06:01:34,477 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/54abb85cdcec41bd8b8850254d6c6285 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/54abb85cdcec41bd8b8850254d6c6285 2023-02-16 06:01:34,478 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/6a74c3fcf57a4d75b146bee20506482a to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/6a74c3fcf57a4d75b146bee20506482a 2023-02-16 06:01:34,480 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/5d4bfa4b78824ade9fa041c0cb46ee3c to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/f2/5d4bfa4b78824ade9fa041c0cb46ee3c 2023-02-16 06:01:34,480 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/f8f48a8035464043b29fa29cbc8529c6 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/f2/f8f48a8035464043b29fa29cbc8529c6 2023-02-16 06:01:34,481 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/1b0542af961a4677bc535f4f0b9ba22d to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/f2/1b0542af961a4677bc535f4f0b9ba22d 2023-02-16 06:01:34,481 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/d87b8ff2ea2d42a690013e13d0085041 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/f2/d87b8ff2ea2d42a690013e13d0085041 2023-02-16 06:01:34,482 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/ae04fa9850404bf28432e894fa1a7033 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/f2/ae04fa9850404bf28432e894fa1a7033 2023-02-16 06:01:34,483 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/f33d2b9c4bb642cf8e12e56bf0eb458e to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/f2/f33d2b9c4bb642cf8e12e56bf0eb458e 2023-02-16 06:01:34,485 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/b1a33df8bdea4220b1d6849e3f9bcd22 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/f2/b1a33df8bdea4220b1d6849e3f9bcd22 2023-02-16 06:01:34,493 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d/recovered.edits/12.seqid 2023-02-16 06:01:34,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/daa01ccb0e487c4292bd567c1978807d 2023-02-16 06:01:34,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:34,495 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4/recovered.edits/12.seqid 2023-02-16 06:01:34,496 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e/recovered.edits/12.seqid 2023-02-16 06:01:34,496 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/b0387e6f23994323803d48fa08663a81 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/b0387e6f23994323803d48fa08663a81 2023-02-16 06:01:34,497 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/cb309f295384b92b146716a3d868cbc4 2023-02-16 06:01:34,498 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc/recovered.edits/12.seqid 2023-02-16 06:01:34,498 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f/recovered.edits/12.seqid 2023-02-16 06:01:34,498 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/837d6d0fbe7d278bbbfa089acf93e13e 2023-02-16 06:01:34,499 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122/recovered.edits/12.seqid 2023-02-16 06:01:34,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/6a0f5ed884463d849746b75f64c0e23f 2023-02-16 06:01:34,500 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7517f88ed11ddd267ae841bdbe7203cc 2023-02-16 06:01:34,501 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/36d3d2895bce6969129ede92f1762122 2023-02-16 06:01:34,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800/recovered.edits/12.seqid 2023-02-16 06:01:34,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f1, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/f2, FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/recovered.edits] 2023-02-16 06:01:34,502 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/7d44aedfaba5db72126598bb1839c800 2023-02-16 06:01:34,503 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/de2ecbc76ba64ef7904b95fa119183a6 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f1/de2ecbc76ba64ef7904b95fa119183a6 2023-02-16 06:01:34,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/2a03166431eb47aab47f5d8523025f05 to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/2a03166431eb47aab47f5d8523025f05 2023-02-16 06:01:34,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 06:01:34,509 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/945ad72fdae949d7a6664457710f67cf to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/f2/945ad72fdae949d7a6664457710f67cf 2023-02-16 06:01:34,510 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/recovered.edits/6.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d/recovered.edits/6.seqid 2023-02-16 06:01:34,511 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/ff0137857a747de2bae138ee6b34af0d 2023-02-16 06:01:34,513 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/recovered.edits/12.seqid to hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/archive/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01/recovered.edits/12.seqid 2023-02-16 06:01:34,514 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/.tmp/data/default/testWithMapReduce/61ec816f64cfa470e201b3506a650d01 2023-02-16 06:01:34,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 06:01:34,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:01:34,551 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-16 06:01:34,558 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 06:01:34,560 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:01:34,560 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 06:01:34,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676527283797.36d3d2895bce6969129ede92f1762122.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527294560"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,567 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 06:01:34,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04887ecd84d8b054339e66cee27da227, NAME => 'testWithMapReduce,,1676527283797.04887ecd84d8b054339e66cee27da227.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 7d44aedfaba5db72126598bb1839c800, NAME => 'testWithMapReduce,aaa,1676527283797.7d44aedfaba5db72126598bb1839c800.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => daa01ccb0e487c4292bd567c1978807d, NAME => 'testWithMapReduce,d\x84\x84,1676527283797.daa01ccb0e487c4292bd567c1978807d.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 837d6d0fbe7d278bbbfa089acf93e13e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527283797.837d6d0fbe7d278bbbfa089acf93e13e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 7517f88ed11ddd267ae841bdbe7203cc, NAME => 'testWithMapReduce,j\xCA\xCA,1676527283797.7517f88ed11ddd267ae841bdbe7203cc.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 36d3d2895bce6969129ede92f1762122, NAME => 'testWithMapReduce,m\xED\xED,1676527283797.36d3d2895bce6969129ede92f1762122.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 6a0f5ed884463d849746b75f64c0e23f, NAME => 'testWithMapReduce,q\x11\x10,1676527283797.6a0f5ed884463d849746b75f64c0e23f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => cb309f295384b92b146716a3d868cbc4, NAME => 'testWithMapReduce,t43,1676527283797.cb309f295384b92b146716a3d868cbc4.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 61ec816f64cfa470e201b3506a650d01, NAME => 'testWithMapReduce,wWV,1676527283797.61ec816f64cfa470e201b3506a650d01.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => ff0137857a747de2bae138ee6b34af0d, NAME => 'testWithMapReduce,zz{,1676527283797.ff0137857a747de2bae138ee6b34af0d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 06:01:34,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 06:01:34,568 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676527294568"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:34,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 06:01:34,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:01:34,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 182 msec 2023-02-16 06:01:34,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45865] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 06:01:34,710 INFO [Listener at localhost/44557] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-16 06:01:34,710 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:01:34,710 INFO [Listener at localhost/44557] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:01:34,711 DEBUG [Listener at localhost/44557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54183f42 to 127.0.0.1:53727 2023-02-16 06:01:34,711 DEBUG [Listener at localhost/44557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:34,711 DEBUG [Listener at localhost/44557] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:01:34,711 DEBUG [Listener at localhost/44557] util.JVMClusterUtil(257): Found active master hash=38618513, stopped=false 2023-02-16 06:01:34,711 INFO [Listener at localhost/44557] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:34,714 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:34,714 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:34,714 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:34,714 INFO [Listener at localhost/44557] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:01:34,714 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:34,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:34,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:34,716 DEBUG [Listener at localhost/44557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2238469d to 127.0.0.1:53727 2023-02-16 06:01:34,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:34,716 DEBUG [Listener at localhost/44557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:34,716 INFO [Listener at localhost/44557] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40759,1676527280787' ***** 2023-02-16 06:01:34,717 INFO [Listener at localhost/44557] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:34,718 INFO [Listener at localhost/44557] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44983,1676527280837' ***** 2023-02-16 06:01:34,718 INFO [Listener at localhost/44557] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:34,718 INFO [RS:0;jenkins-hbase4:40759] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:34,718 INFO [RS:1;jenkins-hbase4:44983] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:34,718 INFO [RS:1;jenkins-hbase4:44983] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:34,718 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:34,718 INFO [RS:1;jenkins-hbase4:44983] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:34,718 INFO [RS:0;jenkins-hbase4:40759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:34,718 INFO [RS:0;jenkins-hbase4:40759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:34,719 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:34,719 DEBUG [RS:0;jenkins-hbase4:40759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55b79b91 to 127.0.0.1:53727 2023-02-16 06:01:34,719 DEBUG [RS:0;jenkins-hbase4:40759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:34,719 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40759,1676527280787; all regions closed. 2023-02-16 06:01:34,719 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(3304): Received CLOSE for c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:34,719 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:34,720 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:34,720 DEBUG [RS:1;jenkins-hbase4:44983] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a3d4524 to 127.0.0.1:53727 2023-02-16 06:01:34,721 DEBUG [RS:1;jenkins-hbase4:44983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:34,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7bdcc8aa5367f1afa65c06cfc2f9136, disabling compactions & flushes 2023-02-16 06:01:34,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:34,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:34,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. after waiting 0 ms 2023-02-16 06:01:34,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:34,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c7bdcc8aa5367f1afa65c06cfc2f9136 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:01:34,721 INFO [RS:1;jenkins-hbase4:44983] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:34,723 INFO [RS:1;jenkins-hbase4:44983] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:34,723 INFO [RS:1;jenkins-hbase4:44983] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:34,723 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:01:34,731 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 06:01:34,731 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1479): Online Regions={c7bdcc8aa5367f1afa65c06cfc2f9136=hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 06:01:34,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:34,732 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:34,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:34,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:34,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:34,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-16 06:01:34,735 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1505): Waiting on 1588230740, c7bdcc8aa5367f1afa65c06cfc2f9136 2023-02-16 06:01:34,743 DEBUG [RS:0;jenkins-hbase4:40759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/oldWALs 2023-02-16 06:01:34,743 INFO [RS:0;jenkins-hbase4:40759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40759%2C1676527280787:(num 1676527283260) 2023-02-16 06:01:34,743 DEBUG [RS:0;jenkins-hbase4:40759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:34,743 INFO [RS:0;jenkins-hbase4:40759] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:34,743 INFO [RS:0;jenkins-hbase4:40759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:34,744 INFO [RS:0;jenkins-hbase4:40759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:34,744 INFO [RS:0;jenkins-hbase4:40759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:34,744 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:34,744 INFO [RS:0;jenkins-hbase4:40759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:34,770 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:34,770 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:34,770 INFO [RS:0;jenkins-hbase4:40759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40759 2023-02-16 06:01:34,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/.tmp/info/926285b99d244b5a86ece2bbbc681074 2023-02-16 06:01:34,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/.tmp/info/54359ee5bd7748eea9231a73dfaae421 2023-02-16 06:01:34,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/.tmp/info/926285b99d244b5a86ece2bbbc681074 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/info/926285b99d244b5a86ece2bbbc681074 2023-02-16 06:01:34,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54359ee5bd7748eea9231a73dfaae421 2023-02-16 06:01:34,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/info/926285b99d244b5a86ece2bbbc681074, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:01:34,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c7bdcc8aa5367f1afa65c06cfc2f9136 in 83ms, sequenceid=6, compaction requested=false 2023-02-16 06:01:34,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/namespace/c7bdcc8aa5367f1afa65c06cfc2f9136/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:01:34,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:34,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7bdcc8aa5367f1afa65c06cfc2f9136: 2023-02-16 06:01:34,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527282851.c7bdcc8aa5367f1afa65c06cfc2f9136. 2023-02-16 06:01:34,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/.tmp/rep_barrier/11e4916bb2ab405697daa9d9057caf5d 2023-02-16 06:01:34,826 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:34,826 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:34,826 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:34,827 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40759,1676527280787] 2023-02-16 06:01:34,827 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40759,1676527280787; numProcessing=1 2023-02-16 06:01:34,828 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40759,1676527280787 2023-02-16 06:01:34,828 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@619ca463 rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:34,828 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:34,828 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@15f04933 rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:34,829 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40759,1676527280787 already deleted, retry=false 2023-02-16 06:01:34,829 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40759,1676527280787 expired; onlineServers=1 2023-02-16 06:01:34,831 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11e4916bb2ab405697daa9d9057caf5d 2023-02-16 06:01:34,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/.tmp/table/ecdf41b5413b4c4e8fe040e4dc5a1582 2023-02-16 06:01:34,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecdf41b5413b4c4e8fe040e4dc5a1582 2023-02-16 06:01:34,872 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/.tmp/info/54359ee5bd7748eea9231a73dfaae421 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/info/54359ee5bd7748eea9231a73dfaae421 2023-02-16 06:01:34,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54359ee5bd7748eea9231a73dfaae421 2023-02-16 06:01:34,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/info/54359ee5bd7748eea9231a73dfaae421, entries=30, sequenceid=57, filesize=7.9 K 2023-02-16 06:01:34,880 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/.tmp/rep_barrier/11e4916bb2ab405697daa9d9057caf5d as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/rep_barrier/11e4916bb2ab405697daa9d9057caf5d 2023-02-16 06:01:34,886 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11e4916bb2ab405697daa9d9057caf5d 2023-02-16 06:01:34,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/rep_barrier/11e4916bb2ab405697daa9d9057caf5d, entries=10, sequenceid=57, filesize=5.9 K 2023-02-16 06:01:34,888 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/.tmp/table/ecdf41b5413b4c4e8fe040e4dc5a1582 as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/table/ecdf41b5413b4c4e8fe040e4dc5a1582 2023-02-16 06:01:34,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecdf41b5413b4c4e8fe040e4dc5a1582 2023-02-16 06:01:34,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/table/ecdf41b5413b4c4e8fe040e4dc5a1582, entries=13, sequenceid=57, filesize=5.9 K 2023-02-16 06:01:34,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 170ms, sequenceid=57, compaction requested=false 2023-02-16 06:01:34,935 DEBUG [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 06:01:34,937 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 06:01:34,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:01:34,939 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:34,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:34,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:35,116 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:35,116 INFO [RS:0;jenkins-hbase4:40759] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40759,1676527280787; zookeeper connection closed. 2023-02-16 06:01:35,116 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d70f18f rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,116 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:40759-0x1005bb803e50001, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:35,116 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@340e8fbc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@340e8fbc 2023-02-16 06:01:35,116 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57a021e4 rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,135 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44983,1676527280837; all regions closed. 2023-02-16 06:01:35,141 DEBUG [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/oldWALs 2023-02-16 06:01:35,141 INFO [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44983%2C1676527280837.meta:.meta(num 1676527282570) 2023-02-16 06:01:35,146 DEBUG [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/oldWALs 2023-02-16 06:01:35,146 INFO [RS:1;jenkins-hbase4:44983] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44983%2C1676527280837:(num 1676527283261) 2023-02-16 06:01:35,146 DEBUG [RS:1;jenkins-hbase4:44983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:35,146 INFO [RS:1;jenkins-hbase4:44983] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:35,146 INFO [RS:1;jenkins-hbase4:44983] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:35,147 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:35,147 INFO [RS:1;jenkins-hbase4:44983] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44983 2023-02-16 06:01:35,150 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:35,150 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44983,1676527280837 2023-02-16 06:01:35,150 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@124d3be5 rejected from java.util.concurrent.ThreadPoolExecutor@1672ad74[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,152 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44983,1676527280837] 2023-02-16 06:01:35,152 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44983,1676527280837; numProcessing=2 2023-02-16 06:01:35,154 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44983,1676527280837 already deleted, retry=false 2023-02-16 06:01:35,154 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44983,1676527280837 expired; onlineServers=0 2023-02-16 06:01:35,154 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45865,1676527279500' ***** 2023-02-16 06:01:35,154 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:01:35,155 DEBUG [M:0;jenkins-hbase4:45865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43704faa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:35,155 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45865,1676527279500 2023-02-16 06:01:35,155 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45865,1676527279500; all regions closed. 2023-02-16 06:01:35,155 DEBUG [M:0;jenkins-hbase4:45865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:35,155 DEBUG [M:0;jenkins-hbase4:45865] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:01:35,155 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:01:35,155 DEBUG [M:0;jenkins-hbase4:45865] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:01:35,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527282045] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527282045,5,FailOnTimeoutGroup] 2023-02-16 06:01:35,156 INFO [M:0;jenkins-hbase4:45865] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:01:35,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527282044] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527282044,5,FailOnTimeoutGroup] 2023-02-16 06:01:35,157 INFO [M:0;jenkins-hbase4:45865] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:01:35,157 INFO [M:0;jenkins-hbase4:45865] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:01:35,157 DEBUG [M:0;jenkins-hbase4:45865] master.HMaster(1512): Stopping service threads 2023-02-16 06:01:35,157 INFO [M:0;jenkins-hbase4:45865] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:01:35,158 ERROR [M:0;jenkins-hbase4:45865] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:01:35,158 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] 2023-02-16 06:01:35,158 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-16 06:01:35,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:35,159 INFO [M:0;jenkins-hbase4:45865] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:01:35,159 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:01:35,159 DEBUG [M:0;jenkins-hbase4:45865] zookeeper.ZKUtil(398): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 06:01:35,159 WARN [M:0;jenkins-hbase4:45865] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 06:01:35,159 INFO [M:0;jenkins-hbase4:45865] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:01:35,160 INFO [M:0;jenkins-hbase4:45865] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:01:35,160 DEBUG [M:0;jenkins-hbase4:45865] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:35,160 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:35,160 DEBUG [M:0;jenkins-hbase4:45865] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:35,160 DEBUG [M:0;jenkins-hbase4:45865] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:35,160 DEBUG [M:0;jenkins-hbase4:45865] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:35,160 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.19 KB 2023-02-16 06:01:35,180 INFO [M:0;jenkins-hbase4:45865] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/942b81e2abd44f339274edd45836ea5c 2023-02-16 06:01:35,187 DEBUG [M:0;jenkins-hbase4:45865] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/942b81e2abd44f339274edd45836ea5c as hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/942b81e2abd44f339274edd45836ea5c 2023-02-16 06:01:35,193 INFO [M:0;jenkins-hbase4:45865] regionserver.HStore(1080): Added hdfs://localhost:32817/user/jenkins/test-data/bebcbec5-5603-4cf1-f036-47fae310ce41/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/942b81e2abd44f339274edd45836ea5c, entries=53, sequenceid=357, filesize=10.4 K 2023-02-16 06:01:35,194 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=357, compaction requested=false 2023-02-16 06:01:35,196 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:35,196 DEBUG [M:0;jenkins-hbase4:45865] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:35,202 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:35,202 INFO [M:0;jenkins-hbase4:45865] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:01:35,203 INFO [M:0;jenkins-hbase4:45865] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45865 2023-02-16 06:01:35,206 DEBUG [M:0;jenkins-hbase4:45865] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45865,1676527279500 already deleted, retry=false 2023-02-16 06:01:35,252 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:35,252 INFO [RS:1;jenkins-hbase4:44983] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44983,1676527280837; zookeeper connection closed. 2023-02-16 06:01:35,252 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19807752 rejected from java.util.concurrent.ThreadPoolExecutor@1672ad74[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,252 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): regionserver:44983-0x1005bb803e50002, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:35,252 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@61f3fdb0 rejected from java.util.concurrent.ThreadPoolExecutor@1672ad74[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,252 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56535a97] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56535a97 2023-02-16 06:01:35,253 INFO [Listener at localhost/44557] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:01:35,352 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:35,352 INFO [M:0;jenkins-hbase4:45865] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45865,1676527279500; zookeeper connection closed. 2023-02-16 06:01:35,352 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e4d6b6a rejected from java.util.concurrent.ThreadPoolExecutor@206ba089[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,352 DEBUG [Listener at localhost/44557-EventThread] zookeeper.ZKWatcher(600): master:45865-0x1005bb803e50000, quorum=127.0.0.1:53727, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:35,352 ERROR [Listener at localhost/44557-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3aed835 rejected from java.util.concurrent.ThreadPoolExecutor@206ba089[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:35,354 WARN [Listener at localhost/44557] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:35,358 INFO [Listener at localhost/44557] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:35,463 WARN [BP-1145129676-172.31.14.131-1676527275849 heartbeating to localhost/127.0.0.1:32817] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:35,463 WARN [BP-1145129676-172.31.14.131-1676527275849 heartbeating to localhost/127.0.0.1:32817] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1145129676-172.31.14.131-1676527275849 (Datanode Uuid 66b5860c-ccd2-46bd-a628-99a1eecdada0) service to localhost/127.0.0.1:32817 2023-02-16 06:01:35,465 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/dfs/data/data3/current/BP-1145129676-172.31.14.131-1676527275849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:35,465 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/dfs/data/data4/current/BP-1145129676-172.31.14.131-1676527275849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:35,467 WARN [Listener at localhost/44557] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:35,471 INFO [Listener at localhost/44557] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:35,575 WARN [BP-1145129676-172.31.14.131-1676527275849 heartbeating to localhost/127.0.0.1:32817] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:35,575 WARN [BP-1145129676-172.31.14.131-1676527275849 heartbeating to localhost/127.0.0.1:32817] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1145129676-172.31.14.131-1676527275849 (Datanode Uuid 9532290e-61a1-4dcb-b8c1-e06544af2508) service to localhost/127.0.0.1:32817 2023-02-16 06:01:35,576 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/dfs/data/data1/current/BP-1145129676-172.31.14.131-1676527275849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:35,576 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/cluster_67260ec7-7c96-1d4c-0de5-8d788e7552f1/dfs/data/data2/current/BP-1145129676-172.31.14.131-1676527275849] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:35,615 INFO [Listener at localhost/44557] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:35,735 INFO [Listener at localhost/44557] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:01:35,804 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:01:35,818 INFO [Listener at localhost/44557] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:32817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:32817 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:32817 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:32817 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32817 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45865,1676527279500)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:32817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@18adb086 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:32817 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/44557 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=554 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=2530 (was 4115) 2023-02-16 06:01:35,826 INFO [Listener at localhost/44557] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=554, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=168, AvailableMemoryMB=2530 2023-02-16 06:01:35,838 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop.log.dir so I do NOT create it in target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003 2023-02-16 06:01:35,838 WARN [Listener at localhost/44557] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 06:01:35,838 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop.tmp.dir so I do NOT create it in target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003 2023-02-16 06:01:35,838 WARN [Listener at localhost/44557] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d33a8584-2ffb-0364-7129-64206bf351e5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 06:01:35,838 DEBUG [Listener at localhost/44557] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003 2023-02-16 06:01:35,838 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:01:35,838 INFO [Listener at localhost/44557] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348, deleteOnExit=true 2023-02-16 06:01:35,838 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:01:35,838 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/test.cache.data in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:01:35,839 DEBUG [Listener at localhost/44557] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:35,839 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:01:35,840 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:35,841 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:01:35,841 INFO [Listener at localhost/44557] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:01:35,845 WARN [Listener at localhost/44557] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:35,845 WARN [Listener at localhost/44557] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:35,894 WARN [Listener at localhost/44557] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:35,896 INFO [Listener at localhost/44557] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:35,904 INFO [Listener at localhost/44557] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/java.io.tmpdir/Jetty_localhost_42021_hdfs____cfjv8b/webapp 2023-02-16 06:01:36,001 INFO [Listener at localhost/44557] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42021 2023-02-16 06:01:36,006 WARN [Listener at localhost/44557] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:36,006 WARN [Listener at localhost/44557] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:36,054 WARN [Listener at localhost/38621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:36,067 WARN [Listener at localhost/38621] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:36,070 WARN [Listener at localhost/38621] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:36,071 INFO [Listener at localhost/38621] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:36,079 INFO [Listener at localhost/38621] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/java.io.tmpdir/Jetty_localhost_36241_datanode____mp3r9v/webapp 2023-02-16 06:01:36,177 INFO [Listener at localhost/38621] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36241 2023-02-16 06:01:36,184 WARN [Listener at localhost/42845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:36,198 WARN [Listener at localhost/42845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:36,201 WARN [Listener at localhost/42845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:36,202 INFO [Listener at localhost/42845] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:36,206 INFO [Listener at localhost/42845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/java.io.tmpdir/Jetty_localhost_39399_datanode____cpfs9g/webapp 2023-02-16 06:01:36,297 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa73fadb856416e5a: Processing first storage report for DS-a85f09f5-0dd4-4b07-a182-80247d84b101 from datanode 92bd52d2-b076-4d3e-ab46-b1196089c88f 2023-02-16 06:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa73fadb856416e5a: from storage DS-a85f09f5-0dd4-4b07-a182-80247d84b101 node DatanodeRegistration(127.0.0.1:34003, datanodeUuid=92bd52d2-b076-4d3e-ab46-b1196089c88f, infoPort=45733, infoSecurePort=0, ipcPort=42845, storageInfo=lv=-57;cid=testClusterID;nsid=790089493;c=1676527295848), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa73fadb856416e5a: Processing first storage report for DS-c2ac6693-584c-47af-b0b2-9e9745fe6aba from datanode 92bd52d2-b076-4d3e-ab46-b1196089c88f 2023-02-16 06:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa73fadb856416e5a: from storage DS-c2ac6693-584c-47af-b0b2-9e9745fe6aba node DatanodeRegistration(127.0.0.1:34003, datanodeUuid=92bd52d2-b076-4d3e-ab46-b1196089c88f, infoPort=45733, infoSecurePort=0, ipcPort=42845, storageInfo=lv=-57;cid=testClusterID;nsid=790089493;c=1676527295848), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:36,319 INFO [Listener at localhost/42845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39399 2023-02-16 06:01:36,326 WARN [Listener at localhost/45879] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:36,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2079b2fb6fa8e50: Processing first storage report for DS-33afcf73-bc57-4a96-8f6c-391b4e92262f from datanode 0565f921-12f2-4092-86b7-340457e44cb6 2023-02-16 06:01:36,442 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2079b2fb6fa8e50: from storage DS-33afcf73-bc57-4a96-8f6c-391b4e92262f node DatanodeRegistration(127.0.0.1:43221, datanodeUuid=0565f921-12f2-4092-86b7-340457e44cb6, infoPort=35141, infoSecurePort=0, ipcPort=45879, storageInfo=lv=-57;cid=testClusterID;nsid=790089493;c=1676527295848), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:36,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2079b2fb6fa8e50: Processing first storage report for DS-58923c05-7809-4a8b-8596-456211a95fe7 from datanode 0565f921-12f2-4092-86b7-340457e44cb6 2023-02-16 06:01:36,443 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2079b2fb6fa8e50: from storage DS-58923c05-7809-4a8b-8596-456211a95fe7 node DatanodeRegistration(127.0.0.1:43221, datanodeUuid=0565f921-12f2-4092-86b7-340457e44cb6, infoPort=35141, infoSecurePort=0, ipcPort=45879, storageInfo=lv=-57;cid=testClusterID;nsid=790089493;c=1676527295848), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 06:01:36,544 DEBUG [Listener at localhost/45879] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003 2023-02-16 06:01:36,547 INFO [Listener at localhost/45879] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/zookeeper_0, clientPort=61721, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:01:36,548 INFO [Listener at localhost/45879] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61721 2023-02-16 06:01:36,549 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,550 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,572 INFO [Listener at localhost/45879] util.FSUtils(479): Created version file at hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc with version=8 2023-02-16 06:01:36,572 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,573 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,575 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/hbase-staging 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:36,577 INFO [Listener at localhost/45879] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:36,579 INFO [Listener at localhost/45879] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36811 2023-02-16 06:01:36,580 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,581 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,582 INFO [Listener at localhost/45879] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36811 connecting to ZooKeeper ensemble=127.0.0.1:61721 2023-02-16 06:01:36,592 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:368110x0, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:36,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36811-0x1005bb849e70000 connected 2023-02-16 06:01:36,623 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:36,624 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:36,625 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:36,628 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36811 2023-02-16 06:01:36,628 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36811 2023-02-16 06:01:36,636 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36811 2023-02-16 06:01:36,640 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36811 2023-02-16 06:01:36,640 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36811 2023-02-16 06:01:36,640 INFO [Listener at localhost/45879] master.HMaster(444): hbase.rootdir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc, hbase.cluster.distributed=false 2023-02-16 06:01:36,661 INFO [Listener at localhost/45879] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:36,661 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,662 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,662 INFO [Listener at localhost/45879] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:36,662 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,662 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:36,662 INFO [Listener at localhost/45879] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:36,664 INFO [Listener at localhost/45879] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38171 2023-02-16 06:01:36,664 INFO [Listener at localhost/45879] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:36,667 DEBUG [Listener at localhost/45879] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:36,668 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,669 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,670 INFO [Listener at localhost/45879] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38171 connecting to ZooKeeper ensemble=127.0.0.1:61721 2023-02-16 06:01:36,673 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:381710x0, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:36,674 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): regionserver:381710x0, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:36,674 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): regionserver:381710x0, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:36,675 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): regionserver:381710x0, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:36,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38171-0x1005bb849e70001 connected 2023-02-16 06:01:36,679 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38171 2023-02-16 06:01:36,680 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38171 2023-02-16 06:01:36,682 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38171 2023-02-16 06:01:36,683 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38171 2023-02-16 06:01:36,684 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38171 2023-02-16 06:01:36,696 INFO [Listener at localhost/45879] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:36,696 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,696 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,697 INFO [Listener at localhost/45879] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:36,697 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:36,697 INFO [Listener at localhost/45879] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:36,697 INFO [Listener at localhost/45879] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:36,700 INFO [Listener at localhost/45879] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38755 2023-02-16 06:01:36,700 INFO [Listener at localhost/45879] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:36,701 DEBUG [Listener at localhost/45879] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:36,701 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,702 INFO [Listener at localhost/45879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,703 INFO [Listener at localhost/45879] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38755 connecting to ZooKeeper ensemble=127.0.0.1:61721 2023-02-16 06:01:36,707 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:387550x0, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:36,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38755-0x1005bb849e70002 connected 2023-02-16 06:01:36,708 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:36,709 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:36,709 DEBUG [Listener at localhost/45879] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:36,710 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38755 2023-02-16 06:01:36,710 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38755 2023-02-16 06:01:36,716 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38755 2023-02-16 06:01:36,716 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38755 2023-02-16 06:01:36,717 DEBUG [Listener at localhost/45879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38755 2023-02-16 06:01:36,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,722 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:36,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,724 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:36,724 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:36,724 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:36,724 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:36,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:36,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:36,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36811,1676527296576 from backup master directory 2023-02-16 06:01:36,728 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,728 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:36,728 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:36,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/hbase.id with ID: a3e468c2-71d4-42bb-8544-4aa227fdf6fe 2023-02-16 06:01:36,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:36,758 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:36,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x50ce60fb to 127.0.0.1:61721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:36,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e44e763, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:36,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:36,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:01:36,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:36,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store-tmp 2023-02-16 06:01:36,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:36,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:36,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:36,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:36,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:36,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:36,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:36,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:36,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/WALs/jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36811%2C1676527296576, suffix=, logDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/WALs/jenkins-hbase4.apache.org,36811,1676527296576, archiveDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/oldWALs, maxLogs=10 2023-02-16 06:01:36,812 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK] 2023-02-16 06:01:36,814 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK] 2023-02-16 06:01:36,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/WALs/jenkins-hbase4.apache.org,36811,1676527296576/jenkins-hbase4.apache.org%2C36811%2C1676527296576.1676527296796 2023-02-16 06:01:36,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK], DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK]] 2023-02-16 06:01:36,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:36,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:36,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:36,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:36,822 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:36,823 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:01:36,824 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:01:36,825 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:36,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:36,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:36,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:36,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:36,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75029822, jitterRate=0.11803147196769714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:36,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:36,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:01:36,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:01:36,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:01:36,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:01:36,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 06:01:36,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 06:01:36,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:01:36,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:01:36,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:01:36,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:01:36,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:01:36,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:01:36,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:01:36,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:01:36,856 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:36,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:01:36,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:01:36,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:01:36,858 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:36,859 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:36,859 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:36,859 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:36,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36811,1676527296576, sessionid=0x1005bb849e70000, setting cluster-up flag (Was=false) 2023-02-16 06:01:36,865 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:36,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:01:36,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,873 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:36,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:01:36,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:36,879 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.hbase-snapshot/.tmp 2023-02-16 06:01:36,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:36,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:36,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527326888 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:01:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:36,889 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:36,890 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:01:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:01:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:01:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:01:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:01:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:01:36,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527296890,5,FailOnTimeoutGroup] 2023-02-16 06:01:36,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527296890,5,FailOnTimeoutGroup] 2023-02-16 06:01:36,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:36,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:01:36,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:36,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:36,891 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:36,906 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:36,912 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:36,912 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc 2023-02-16 06:01:36,921 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(952): ClusterId : a3e468c2-71d4-42bb-8544-4aa227fdf6fe 2023-02-16 06:01:36,922 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:36,922 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(952): ClusterId : a3e468c2-71d4-42bb-8544-4aa227fdf6fe 2023-02-16 06:01:36,922 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:36,924 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:36,924 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:36,924 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:36,925 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:36,927 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:36,927 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:36,931 DEBUG [RS:1;jenkins-hbase4:38755] zookeeper.ReadOnlyZKClient(139): Connect 0x2c3fe881 to 127.0.0.1:61721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:36,931 DEBUG [RS:0;jenkins-hbase4:38171] zookeeper.ReadOnlyZKClient(139): Connect 0x5bb7c21a to 127.0.0.1:61721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:36,940 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:36,948 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:36,949 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/info 2023-02-16 06:01:36,951 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:36,951 DEBUG [RS:0;jenkins-hbase4:38171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5570371c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:36,951 DEBUG [RS:0;jenkins-hbase4:38171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@514fa96a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:36,951 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:36,952 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:36,956 DEBUG [RS:1;jenkins-hbase4:38755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22f80376, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:36,956 DEBUG [RS:1;jenkins-hbase4:38755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26c783f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:36,965 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38171 2023-02-16 06:01:36,965 INFO [RS:0;jenkins-hbase4:38171] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:36,965 INFO [RS:0;jenkins-hbase4:38171] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:36,965 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:36,965 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36811,1676527296576 with isa=jenkins-hbase4.apache.org/172.31.14.131:38171, startcode=1676527296661 2023-02-16 06:01:36,966 DEBUG [RS:0;jenkins-hbase4:38171] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:36,968 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38755 2023-02-16 06:01:36,968 INFO [RS:1;jenkins-hbase4:38755] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:36,968 INFO [RS:1;jenkins-hbase4:38755] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:36,968 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:36,976 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:36,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:36,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:36,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:36,985 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/table 2023-02-16 06:01:36,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:36,987 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:36,988 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740 2023-02-16 06:01:36,988 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740 2023-02-16 06:01:36,989 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36811,1676527296576 with isa=jenkins-hbase4.apache.org/172.31.14.131:38755, startcode=1676527296696 2023-02-16 06:01:36,990 DEBUG [RS:1;jenkins-hbase4:38755] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:36,990 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58917, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:36,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:36,992 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc 2023-02-16 06:01:36,992 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38621 2023-02-16 06:01:36,992 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:36,992 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:36,995 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:37,000 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:37,001 DEBUG [RS:0;jenkins-hbase4:38171] zookeeper.ZKUtil(162): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,001 WARN [RS:0;jenkins-hbase4:38171] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:37,001 INFO [RS:0;jenkins-hbase4:38171] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:37,001 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,018 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56785, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:37,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,019 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc 2023-02-16 06:01:37,019 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38621 2023-02-16 06:01:37,019 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:37,023 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:37,036 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67512240, jitterRate=0.006010770797729492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:37,036 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:37,036 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:37,036 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:37,036 DEBUG [RS:1;jenkins-hbase4:38755] zookeeper.ZKUtil(162): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,036 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38755,1676527296696] 2023-02-16 06:01:37,036 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38171,1676527296661] 2023-02-16 06:01:37,036 WARN [RS:1;jenkins-hbase4:38755] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:37,036 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:37,036 INFO [RS:1;jenkins-hbase4:38755] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:37,036 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:37,036 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:37,036 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,041 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:37,041 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:37,043 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:37,043 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:01:37,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:01:37,044 DEBUG [RS:0;jenkins-hbase4:38171] zookeeper.ZKUtil(162): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,045 DEBUG [RS:0;jenkins-hbase4:38171] zookeeper.ZKUtil(162): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,045 DEBUG [RS:1;jenkins-hbase4:38755] zookeeper.ZKUtil(162): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,045 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:01:37,046 DEBUG [RS:1;jenkins-hbase4:38755] zookeeper.ZKUtil(162): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,046 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:01:37,047 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:37,047 INFO [RS:1;jenkins-hbase4:38755] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:37,048 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:37,048 INFO [RS:0;jenkins-hbase4:38171] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:37,050 INFO [RS:1;jenkins-hbase4:38755] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:37,050 INFO [RS:0;jenkins-hbase4:38171] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:37,051 INFO [RS:1;jenkins-hbase4:38755] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:37,051 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,053 INFO [RS:0;jenkins-hbase4:38171] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:37,053 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:37,053 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,053 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:37,054 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:37,055 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:1;jenkins-hbase4:38755] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,055 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:37,056 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,056 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,056 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,056 DEBUG [RS:0;jenkins-hbase4:38171] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:37,056 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,056 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,056 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,061 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,061 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,061 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,073 INFO [RS:1;jenkins-hbase4:38755] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:37,073 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38755,1676527296696-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,076 INFO [RS:0;jenkins-hbase4:38171] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:37,076 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38171,1676527296661-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,085 INFO [RS:1;jenkins-hbase4:38755] regionserver.Replication(203): jenkins-hbase4.apache.org,38755,1676527296696 started 2023-02-16 06:01:37,085 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38755,1676527296696, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38755, sessionid=0x1005bb849e70002 2023-02-16 06:01:37,085 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:37,085 DEBUG [RS:1;jenkins-hbase4:38755] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,085 DEBUG [RS:1;jenkins-hbase4:38755] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38755,1676527296696' 2023-02-16 06:01:37,085 DEBUG [RS:1;jenkins-hbase4:38755] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38755,1676527296696' 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:37,086 DEBUG [RS:1;jenkins-hbase4:38755] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:37,087 INFO [RS:0;jenkins-hbase4:38171] regionserver.Replication(203): jenkins-hbase4.apache.org,38171,1676527296661 started 2023-02-16 06:01:37,087 DEBUG [RS:1;jenkins-hbase4:38755] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:37,087 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38171,1676527296661, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38171, sessionid=0x1005bb849e70001 2023-02-16 06:01:37,087 INFO [RS:1;jenkins-hbase4:38755] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:37,087 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:37,087 INFO [RS:1;jenkins-hbase4:38755] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:37,087 DEBUG [RS:0;jenkins-hbase4:38171] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,087 DEBUG [RS:0;jenkins-hbase4:38171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38171,1676527296661' 2023-02-16 06:01:37,087 DEBUG [RS:0;jenkins-hbase4:38171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:37,087 DEBUG [RS:0;jenkins-hbase4:38171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38171,1676527296661' 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:37,088 DEBUG [RS:0;jenkins-hbase4:38171] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:37,088 INFO [RS:0;jenkins-hbase4:38171] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:37,088 INFO [RS:0;jenkins-hbase4:38171] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:37,197 DEBUG [jenkins-hbase4:36811] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:01:37,197 DEBUG [jenkins-hbase4:36811] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:37,199 DEBUG [jenkins-hbase4:36811] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:37,199 DEBUG [jenkins-hbase4:36811] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:37,199 DEBUG [jenkins-hbase4:36811] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:37,200 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38171,1676527296661, state=OPENING 2023-02-16 06:01:37,202 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:01:37,203 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:37,203 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:37,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38171,1676527296661}] 2023-02-16 06:01:37,357 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:37,357 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:37,363 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51226, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:37,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:01:37,368 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:37,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38171%2C1676527296661.meta, suffix=.meta, logDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38171,1676527296661, archiveDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/oldWALs, maxLogs=32 2023-02-16 06:01:37,391 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK] 2023-02-16 06:01:37,391 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK] 2023-02-16 06:01:37,393 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38171,1676527296661/jenkins-hbase4.apache.org%2C38171%2C1676527296661.meta.1676527297371.meta 2023-02-16 06:01:37,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK], DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK]] 2023-02-16 06:01:37,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:37,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:01:37,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:01:37,395 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:01:37,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:01:37,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:37,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:01:37,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:01:37,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:37,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/info 2023-02-16 06:01:37,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/info 2023-02-16 06:01:37,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:37,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:37,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:37,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:37,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:37,401 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:37,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:37,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:37,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/table 2023-02-16 06:01:37,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/table 2023-02-16 06:01:37,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:37,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:37,404 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740 2023-02-16 06:01:37,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740 2023-02-16 06:01:37,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:37,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:37,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71205160, jitterRate=0.06103956699371338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:37,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:37,412 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527297357 2023-02-16 06:01:37,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:01:37,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:01:37,418 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38171,1676527296661, state=OPEN 2023-02-16 06:01:37,421 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:01:37,421 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:37,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:01:37,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38171,1676527296661 in 218 msec 2023-02-16 06:01:37,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:01:37,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 380 msec 2023-02-16 06:01:37,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 546 msec 2023-02-16 06:01:37,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527297428, completionTime=-1 2023-02-16 06:01:37,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:01:37,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:01:37,431 DEBUG [hconnection-0x24e0095e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:37,434 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51232, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:37,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:01:37,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527357436 2023-02-16 06:01:37,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527417436 2023-02-16 06:01:37,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1676527296576-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1676527296576-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1676527296576-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36811, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:01:37,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:37,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:01:37,444 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:01:37,445 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:37,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:37,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e empty. 2023-02-16 06:01:37,449 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:01:37,462 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:37,464 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d04e1d9bf6632ad198be14dfa446178e, NAME => 'hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:37,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:37,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d04e1d9bf6632ad198be14dfa446178e, disabling compactions & flushes 2023-02-16 06:01:37,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. after waiting 0 ms 2023-02-16 06:01:37,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d04e1d9bf6632ad198be14dfa446178e: 2023-02-16 06:01:37,485 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:37,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527297486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527297486"}]},"ts":"1676527297486"} 2023-02-16 06:01:37,489 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:01:37,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:37,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527297490"}]},"ts":"1676527297490"} 2023-02-16 06:01:37,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:01:37,495 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:37,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:37,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:37,496 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:37,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d04e1d9bf6632ad198be14dfa446178e, ASSIGN}] 2023-02-16 06:01:37,498 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d04e1d9bf6632ad198be14dfa446178e, ASSIGN 2023-02-16 06:01:37,499 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d04e1d9bf6632ad198be14dfa446178e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38755,1676527296696; forceNewPlan=false, retain=false 2023-02-16 06:01:37,649 INFO [jenkins-hbase4:36811] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:01:37,650 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d04e1d9bf6632ad198be14dfa446178e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,650 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527297650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527297650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527297650"}]},"ts":"1676527297650"} 2023-02-16 06:01:37,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d04e1d9bf6632ad198be14dfa446178e, server=jenkins-hbase4.apache.org,38755,1676527296696}] 2023-02-16 06:01:37,806 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,806 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:37,809 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:37,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,814 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38755%2C1676527296696, suffix=, logDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38755,1676527296696, archiveDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/oldWALs, maxLogs=32 2023-02-16 06:01:37,837 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK] 2023-02-16 06:01:37,838 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK] 2023-02-16 06:01:37,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38755,1676527296696/jenkins-hbase4.apache.org%2C38755%2C1676527296696.1676527297816 2023-02-16 06:01:37,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK], DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK]] 2023-02-16 06:01:37,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d04e1d9bf6632ad198be14dfa446178e, NAME => 'hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:37,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:37,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,848 INFO [StoreOpener-d04e1d9bf6632ad198be14dfa446178e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,849 DEBUG [StoreOpener-d04e1d9bf6632ad198be14dfa446178e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/info 2023-02-16 06:01:37,849 DEBUG [StoreOpener-d04e1d9bf6632ad198be14dfa446178e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/info 2023-02-16 06:01:37,850 INFO [StoreOpener-d04e1d9bf6632ad198be14dfa446178e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d04e1d9bf6632ad198be14dfa446178e columnFamilyName info 2023-02-16 06:01:37,850 INFO [StoreOpener-d04e1d9bf6632ad198be14dfa446178e-1] regionserver.HStore(310): Store=d04e1d9bf6632ad198be14dfa446178e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:37,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:37,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:37,859 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d04e1d9bf6632ad198be14dfa446178e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59240716, jitterRate=-0.11724454164505005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:37,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d04e1d9bf6632ad198be14dfa446178e: 2023-02-16 06:01:37,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e., pid=6, masterSystemTime=1676527297806 2023-02-16 06:01:37,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,865 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:37,866 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d04e1d9bf6632ad198be14dfa446178e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:37,866 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527297866"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527297866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527297866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527297866"}]},"ts":"1676527297866"} 2023-02-16 06:01:37,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:01:37,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d04e1d9bf6632ad198be14dfa446178e, server=jenkins-hbase4.apache.org,38755,1676527296696 in 215 msec 2023-02-16 06:01:37,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:01:37,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d04e1d9bf6632ad198be14dfa446178e, ASSIGN in 374 msec 2023-02-16 06:01:37,872 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:37,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527297873"}]},"ts":"1676527297873"} 2023-02-16 06:01:37,874 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:01:37,877 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:37,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 435 msec 2023-02-16 06:01:37,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:01:37,946 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:37,946 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:37,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:37,953 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:37,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:01:37,968 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:37,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 16 msec 2023-02-16 06:01:37,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:01:37,985 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:37,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-16 06:01:38,002 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:01:38,005 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.277sec 2023-02-16 06:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1676527296576-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1676527296576-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:01:38,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:01:38,021 DEBUG [Listener at localhost/45879] zookeeper.ReadOnlyZKClient(139): Connect 0x3bcefeab to 127.0.0.1:61721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:38,027 DEBUG [Listener at localhost/45879] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38dbf29c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:38,031 DEBUG [hconnection-0x8a6588f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:38,034 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:38,035 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:38,036 DEBUG [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:01:38,038 DEBUG [Listener at localhost/45879] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:01:38,040 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43214, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:01:38,040 INFO [Listener at localhost/45879] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 06:01:38,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 06:01:38,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:01:38,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:43214 deadline: 1676527358041, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 06:01:38,042 INFO [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 06:01:38,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:38,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 06:01:38,047 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:38,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 06:01:38,048 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:38,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,058 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,057 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,058 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49 empty. 2023-02-16 06:01:38,058 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f empty. 2023-02-16 06:01:38,058 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c empty. 2023-02-16 06:01:38,059 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f empty. 2023-02-16 06:01:38,059 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,059 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a empty. 2023-02-16 06:01:38,059 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c empty. 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e empty. 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74 empty. 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642 empty. 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,060 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,061 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,061 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,061 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8 empty. 2023-02-16 06:01:38,061 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,061 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,061 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,061 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 06:01:38,077 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:38,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 117fbd5126f592bcfc584d2acebefd49, NAME => 'testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3a52269a5f08aea7e535029b1f2c0642, NAME => 'testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 66405203c3668dfd93dda67bb3aee13a, NAME => 'testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,090 INFO [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38171%2C1676527296661, suffix=, logDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38171,1676527296661, archiveDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/oldWALs, maxLogs=32 2023-02-16 06:01:38,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 117fbd5126f592bcfc584d2acebefd49, disabling compactions & flushes 2023-02-16 06:01:38,104 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. after waiting 0 ms 2023-02-16 06:01:38,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,105 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:38,105 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f6f56372f62ae23503f9035d0f5207e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,109 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK] 2023-02-16 06:01:38,110 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK] 2023-02-16 06:01:38,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 66405203c3668dfd93dda67bb3aee13a, disabling compactions & flushes 2023-02-16 06:01:38,120 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. after waiting 0 ms 2023-02-16 06:01:38,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,120 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:38,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4fdd91f4e78271f962e0bbf89e0e537f, NAME => 'testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3a52269a5f08aea7e535029b1f2c0642, disabling compactions & flushes 2023-02-16 06:01:38,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. after waiting 0 ms 2023-02-16 06:01:38,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:38,122 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4d5ef427dbe8835395a8e54e1a52c91c, NAME => 'testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,124 INFO [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38171,1676527296661/jenkins-hbase4.apache.org%2C38171%2C1676527296661.1676527298091 2023-02-16 06:01:38,125 DEBUG [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34003,DS-a85f09f5-0dd4-4b07-a182-80247d84b101,DISK], DatanodeInfoWithStorage[127.0.0.1:43221,DS-33afcf73-bc57-4a96-8f6c-391b4e92262f,DISK]] 2023-02-16 06:01:38,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4fdd91f4e78271f962e0bbf89e0e537f, disabling compactions & flushes 2023-02-16 06:01:38,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. after waiting 0 ms 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5f6f56372f62ae23503f9035d0f5207e, disabling compactions & flushes 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,139 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,139 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. after waiting 0 ms 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,139 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,139 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:38,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a1e7630ab1b0edfa00cd1a51f560840c, NAME => 'testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b75faf2c1d6968e78e6d32f5d886762f, NAME => 'testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4d5ef427dbe8835395a8e54e1a52c91c, disabling compactions & flushes 2023-02-16 06:01:38,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. after waiting 0 ms 2023-02-16 06:01:38,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:38,142 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d19c8b1cd01ba9b6f5d03b847e096f74, NAME => 'testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:38,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b75faf2c1d6968e78e6d32f5d886762f, disabling compactions & flushes 2023-02-16 06:01:38,152 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. after waiting 0 ms 2023-02-16 06:01:38,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,152 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:38,153 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a0011662b3ea8e0ef912d56a4c6bada8, NAME => 'testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.tmp 2023-02-16 06:01:38,155 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,155 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a1e7630ab1b0edfa00cd1a51f560840c, disabling compactions & flushes 2023-02-16 06:01:38,155 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,155 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,156 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. after waiting 0 ms 2023-02-16 06:01:38,156 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,156 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,156 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:38,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d19c8b1cd01ba9b6f5d03b847e096f74, disabling compactions & flushes 2023-02-16 06:01:38,160 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. after waiting 0 ms 2023-02-16 06:01:38,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,160 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,160 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:38,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a0011662b3ea8e0ef912d56a4c6bada8, disabling compactions & flushes 2023-02-16 06:01:38,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. after waiting 0 ms 2023-02-16 06:01:38,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:38,165 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:38,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,166 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,167 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527298166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527298166"}]},"ts":"1676527298166"} 2023-02-16 06:01:38,169 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 06:01:38,171 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:38,171 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527298171"}]},"ts":"1676527298171"} 2023-02-16 06:01:38,172 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 06:01:38,176 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:38,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:38,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:38,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:38,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=117fbd5126f592bcfc584d2acebefd49, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3a52269a5f08aea7e535029b1f2c0642, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=66405203c3668dfd93dda67bb3aee13a, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f6f56372f62ae23503f9035d0f5207e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fdd91f4e78271f962e0bbf89e0e537f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d5ef427dbe8835395a8e54e1a52c91c, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b75faf2c1d6968e78e6d32f5d886762f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1e7630ab1b0edfa00cd1a51f560840c, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d19c8b1cd01ba9b6f5d03b847e096f74, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a0011662b3ea8e0ef912d56a4c6bada8, ASSIGN}] 2023-02-16 06:01:38,188 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=66405203c3668dfd93dda67bb3aee13a, ASSIGN 2023-02-16 06:01:38,188 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f6f56372f62ae23503f9035d0f5207e, ASSIGN 2023-02-16 06:01:38,188 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3a52269a5f08aea7e535029b1f2c0642, ASSIGN 2023-02-16 06:01:38,188 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=117fbd5126f592bcfc584d2acebefd49, ASSIGN 2023-02-16 06:01:38,189 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=66405203c3668dfd93dda67bb3aee13a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38171,1676527296661; forceNewPlan=false, retain=false 2023-02-16 06:01:38,189 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5f6f56372f62ae23503f9035d0f5207e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38755,1676527296696; forceNewPlan=false, retain=false 2023-02-16 06:01:38,190 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3a52269a5f08aea7e535029b1f2c0642, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38755,1676527296696; forceNewPlan=false, retain=false 2023-02-16 06:01:38,190 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=117fbd5126f592bcfc584d2acebefd49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38755,1676527296696; forceNewPlan=false, retain=false 2023-02-16 06:01:38,190 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a0011662b3ea8e0ef912d56a4c6bada8, ASSIGN 2023-02-16 06:01:38,191 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d19c8b1cd01ba9b6f5d03b847e096f74, ASSIGN 2023-02-16 06:01:38,191 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1e7630ab1b0edfa00cd1a51f560840c, ASSIGN 2023-02-16 06:01:38,191 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b75faf2c1d6968e78e6d32f5d886762f, ASSIGN 2023-02-16 06:01:38,191 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d5ef427dbe8835395a8e54e1a52c91c, ASSIGN 2023-02-16 06:01:38,192 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a0011662b3ea8e0ef912d56a4c6bada8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38171,1676527296661; forceNewPlan=false, retain=false 2023-02-16 06:01:38,192 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d19c8b1cd01ba9b6f5d03b847e096f74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38755,1676527296696; forceNewPlan=false, retain=false 2023-02-16 06:01:38,193 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b75faf2c1d6968e78e6d32f5d886762f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38755,1676527296696; forceNewPlan=false, retain=false 2023-02-16 06:01:38,193 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a1e7630ab1b0edfa00cd1a51f560840c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38171,1676527296661; forceNewPlan=false, retain=false 2023-02-16 06:01:38,193 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4d5ef427dbe8835395a8e54e1a52c91c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38171,1676527296661; forceNewPlan=false, retain=false 2023-02-16 06:01:38,194 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fdd91f4e78271f962e0bbf89e0e537f, ASSIGN 2023-02-16 06:01:38,194 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4fdd91f4e78271f962e0bbf89e0e537f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38171,1676527296661; forceNewPlan=false, retain=false 2023-02-16 06:01:38,340 INFO [jenkins-hbase4:36811] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 06:01:38,344 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5f6f56372f62ae23503f9035d0f5207e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,344 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d19c8b1cd01ba9b6f5d03b847e096f74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=117fbd5126f592bcfc584d2acebefd49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,344 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b75faf2c1d6968e78e6d32f5d886762f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527298344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298344"}]},"ts":"1676527298344"} 2023-02-16 06:01:38,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3a52269a5f08aea7e535029b1f2c0642, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,344 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298344"}]},"ts":"1676527298344"} 2023-02-16 06:01:38,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298344"}]},"ts":"1676527298344"} 2023-02-16 06:01:38,344 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298344"}]},"ts":"1676527298344"} 2023-02-16 06:01:38,344 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298344"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298344"}]},"ts":"1676527298344"} 2023-02-16 06:01:38,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 117fbd5126f592bcfc584d2acebefd49, server=jenkins-hbase4.apache.org,38755,1676527296696}] 2023-02-16 06:01:38,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure d19c8b1cd01ba9b6f5d03b847e096f74, server=jenkins-hbase4.apache.org,38755,1676527296696}] 2023-02-16 06:01:38,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 3a52269a5f08aea7e535029b1f2c0642, server=jenkins-hbase4.apache.org,38755,1676527296696}] 2023-02-16 06:01:38,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4fdd91f4e78271f962e0bbf89e0e537f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,353 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298353"}]},"ts":"1676527298353"} 2023-02-16 06:01:38,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 5f6f56372f62ae23503f9035d0f5207e, server=jenkins-hbase4.apache.org,38755,1676527296696}] 2023-02-16 06:01:38,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:38,355 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a0011662b3ea8e0ef912d56a4c6bada8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,355 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527298355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298355"}]},"ts":"1676527298355"} 2023-02-16 06:01:38,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure b75faf2c1d6968e78e6d32f5d886762f, server=jenkins-hbase4.apache.org,38755,1676527296696}] 2023-02-16 06:01:38,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 4fdd91f4e78271f962e0bbf89e0e537f, server=jenkins-hbase4.apache.org,38171,1676527296661}] 2023-02-16 06:01:38,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=66405203c3668dfd93dda67bb3aee13a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298360"}]},"ts":"1676527298360"} 2023-02-16 06:01:38,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure a0011662b3ea8e0ef912d56a4c6bada8, server=jenkins-hbase4.apache.org,38171,1676527296661}] 2023-02-16 06:01:38,361 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a1e7630ab1b0edfa00cd1a51f560840c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298361"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298361"}]},"ts":"1676527298361"} 2023-02-16 06:01:38,364 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4d5ef427dbe8835395a8e54e1a52c91c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,365 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298364"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527298364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527298364"}]},"ts":"1676527298364"} 2023-02-16 06:01:38,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 66405203c3668dfd93dda67bb3aee13a, server=jenkins-hbase4.apache.org,38171,1676527296661}] 2023-02-16 06:01:38,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure a1e7630ab1b0edfa00cd1a51f560840c, server=jenkins-hbase4.apache.org,38171,1676527296661}] 2023-02-16 06:01:38,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 4d5ef427dbe8835395a8e54e1a52c91c, server=jenkins-hbase4.apache.org,38171,1676527296661}] 2023-02-16 06:01:38,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b75faf2c1d6968e78e6d32f5d886762f, NAME => 'testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 06:01:38,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,505 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,507 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1 2023-02-16 06:01:38,507 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1 2023-02-16 06:01:38,507 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b75faf2c1d6968e78e6d32f5d886762f columnFamilyName f1 2023-02-16 06:01:38,508 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(310): Store=b75faf2c1d6968e78e6d32f5d886762f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,508 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,510 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2 2023-02-16 06:01:38,510 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2 2023-02-16 06:01:38,510 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b75faf2c1d6968e78e6d32f5d886762f columnFamilyName f2 2023-02-16 06:01:38,511 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(310): Store=b75faf2c1d6968e78e6d32f5d886762f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:38,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d5ef427dbe8835395a8e54e1a52c91c, NAME => 'testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 06:01:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,518 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,519 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1 2023-02-16 06:01:38,519 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1 2023-02-16 06:01:38,519 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5ef427dbe8835395a8e54e1a52c91c columnFamilyName f1 2023-02-16 06:01:38,520 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(310): Store=4d5ef427dbe8835395a8e54e1a52c91c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,520 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,521 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2 2023-02-16 06:01:38,522 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2 2023-02-16 06:01:38,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b75faf2c1d6968e78e6d32f5d886762f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70191569, jitterRate=0.04593588411808014}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:38,522 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5ef427dbe8835395a8e54e1a52c91c columnFamilyName f2 2023-02-16 06:01:38,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f., pid=25, masterSystemTime=1676527298500 2023-02-16 06:01:38,523 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(310): Store=4d5ef427dbe8835395a8e54e1a52c91c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:38,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f6f56372f62ae23503f9035d0f5207e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 06:01:38,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b75faf2c1d6968e78e6d32f5d886762f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298525"}]},"ts":"1676527298525"} 2023-02-16 06:01:38,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-16 06:01:38,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure b75faf2c1d6968e78e6d32f5d886762f, server=jenkins-hbase4.apache.org,38755,1676527296696 in 172 msec 2023-02-16 06:01:38,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:38,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b75faf2c1d6968e78e6d32f5d886762f, ASSIGN in 343 msec 2023-02-16 06:01:38,532 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d5ef427dbe8835395a8e54e1a52c91c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75032054, jitterRate=0.11806473135948181}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:38,534 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1 2023-02-16 06:01:38,534 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1 2023-02-16 06:01:38,535 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f6f56372f62ae23503f9035d0f5207e columnFamilyName f1 2023-02-16 06:01:38,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c., pid=30, masterSystemTime=1676527298513 2023-02-16 06:01:38,535 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(310): Store=5f6f56372f62ae23503f9035d0f5207e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,535 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,537 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2 2023-02-16 06:01:38,537 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2 2023-02-16 06:01:38,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:38,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fdd91f4e78271f962e0bbf89e0e537f, NAME => 'testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 06:01:38,537 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f6f56372f62ae23503f9035d0f5207e columnFamilyName f2 2023-02-16 06:01:38,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4d5ef427dbe8835395a8e54e1a52c91c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298537"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298537"}]},"ts":"1676527298537"} 2023-02-16 06:01:38,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,538 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(310): Store=5f6f56372f62ae23503f9035d0f5207e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,539 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-16 06:01:38,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 4d5ef427dbe8835395a8e54e1a52c91c, server=jenkins-hbase4.apache.org,38171,1676527296661 in 170 msec 2023-02-16 06:01:38,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d5ef427dbe8835395a8e54e1a52c91c, ASSIGN in 355 msec 2023-02-16 06:01:38,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:38,544 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1 2023-02-16 06:01:38,544 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1 2023-02-16 06:01:38,544 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdd91f4e78271f962e0bbf89e0e537f columnFamilyName f1 2023-02-16 06:01:38,545 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(310): Store=4fdd91f4e78271f962e0bbf89e0e537f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,545 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5f6f56372f62ae23503f9035d0f5207e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66306940, jitterRate=-0.011949598789215088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:38,546 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2 2023-02-16 06:01:38,546 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2 2023-02-16 06:01:38,547 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdd91f4e78271f962e0bbf89e0e537f columnFamilyName f2 2023-02-16 06:01:38,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e., pid=24, masterSystemTime=1676527298500 2023-02-16 06:01:38,547 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(310): Store=4fdd91f4e78271f962e0bbf89e0e537f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:38,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3a52269a5f08aea7e535029b1f2c0642, NAME => 'testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 06:01:38,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5f6f56372f62ae23503f9035d0f5207e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,550 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298549"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298549"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298549"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298549"}]},"ts":"1676527298549"} 2023-02-16 06:01:38,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,552 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-16 06:01:38,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 5f6f56372f62ae23503f9035d0f5207e, server=jenkins-hbase4.apache.org,38755,1676527296696 in 198 msec 2023-02-16 06:01:38,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:38,554 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1 2023-02-16 06:01:38,554 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1 2023-02-16 06:01:38,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5f6f56372f62ae23503f9035d0f5207e, ASSIGN in 367 msec 2023-02-16 06:01:38,555 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a52269a5f08aea7e535029b1f2c0642 columnFamilyName f1 2023-02-16 06:01:38,555 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(310): Store=3a52269a5f08aea7e535029b1f2c0642/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,555 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,557 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2 2023-02-16 06:01:38,557 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2 2023-02-16 06:01:38,557 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a52269a5f08aea7e535029b1f2c0642 columnFamilyName f2 2023-02-16 06:01:38,558 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(310): Store=3a52269a5f08aea7e535029b1f2c0642/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fdd91f4e78271f962e0bbf89e0e537f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69227192, jitterRate=0.03156554698944092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:38,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f., pid=26, masterSystemTime=1676527298513 2023-02-16 06:01:38,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:38,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4fdd91f4e78271f962e0bbf89e0e537f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a1e7630ab1b0edfa00cd1a51f560840c, NAME => 'testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 06:01:38,563 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298563"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298563"}]},"ts":"1676527298563"} 2023-02-16 06:01:38,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:38,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-16 06:01:38,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 4fdd91f4e78271f962e0bbf89e0e537f, server=jenkins-hbase4.apache.org,38171,1676527296661 in 207 msec 2023-02-16 06:01:38,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fdd91f4e78271f962e0bbf89e0e537f, ASSIGN in 381 msec 2023-02-16 06:01:38,568 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3a52269a5f08aea7e535029b1f2c0642; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69058239, jitterRate=0.029047951102256775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:38,569 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1 2023-02-16 06:01:38,569 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1 2023-02-16 06:01:38,570 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1e7630ab1b0edfa00cd1a51f560840c columnFamilyName f1 2023-02-16 06:01:38,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642., pid=23, masterSystemTime=1676527298500 2023-02-16 06:01:38,570 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(310): Store=a1e7630ab1b0edfa00cd1a51f560840c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,570 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 117fbd5126f592bcfc584d2acebefd49, NAME => 'testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 06:01:38,572 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3a52269a5f08aea7e535029b1f2c0642, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,572 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298572"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298572"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298572"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298572"}]},"ts":"1676527298572"} 2023-02-16 06:01:38,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,572 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2 2023-02-16 06:01:38,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,572 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2 2023-02-16 06:01:38,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,573 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1e7630ab1b0edfa00cd1a51f560840c columnFamilyName f2 2023-02-16 06:01:38,574 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(310): Store=a1e7630ab1b0edfa00cd1a51f560840c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,574 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,576 DEBUG [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/f1 2023-02-16 06:01:38,576 DEBUG [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/f1 2023-02-16 06:01:38,576 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 117fbd5126f592bcfc584d2acebefd49 columnFamilyName f1 2023-02-16 06:01:38,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-16 06:01:38,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 3a52269a5f08aea7e535029b1f2c0642, server=jenkins-hbase4.apache.org,38755,1676527296696 in 223 msec 2023-02-16 06:01:38,577 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(310): Store=117fbd5126f592bcfc584d2acebefd49/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,577 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3a52269a5f08aea7e535029b1f2c0642, ASSIGN in 391 msec 2023-02-16 06:01:38,578 DEBUG [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/f2 2023-02-16 06:01:38,578 DEBUG [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/f2 2023-02-16 06:01:38,579 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 117fbd5126f592bcfc584d2acebefd49 columnFamilyName f2 2023-02-16 06:01:38,579 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(310): Store=117fbd5126f592bcfc584d2acebefd49/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:38,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:38,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a1e7630ab1b0edfa00cd1a51f560840c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72624606, jitterRate=0.08219096064567566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:38,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c., pid=29, masterSystemTime=1676527298513 2023-02-16 06:01:38,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 117fbd5126f592bcfc584d2acebefd49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61114418, jitterRate=-0.08932420611381531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:38,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49., pid=21, masterSystemTime=1676527298500 2023-02-16 06:01:38,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:38,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a0011662b3ea8e0ef912d56a4c6bada8, NAME => 'testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 06:01:38,588 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a1e7630ab1b0edfa00cd1a51f560840c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,588 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298588"}]},"ts":"1676527298588"} 2023-02-16 06:01:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:38,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d19c8b1cd01ba9b6f5d03b847e096f74, NAME => 'testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 06:01:38,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,590 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=117fbd5126f592bcfc584d2acebefd49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,590 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527298590"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298590"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298590"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298590"}]},"ts":"1676527298590"} 2023-02-16 06:01:38,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,592 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-16 06:01:38,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure a1e7630ab1b0edfa00cd1a51f560840c, server=jenkins-hbase4.apache.org,38171,1676527296661 in 220 msec 2023-02-16 06:01:38,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-16 06:01:38,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 117fbd5126f592bcfc584d2acebefd49, server=jenkins-hbase4.apache.org,38755,1676527296696 in 245 msec 2023-02-16 06:01:38,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a1e7630ab1b0edfa00cd1a51f560840c, ASSIGN in 407 msec 2023-02-16 06:01:38,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=117fbd5126f592bcfc584d2acebefd49, ASSIGN in 409 msec 2023-02-16 06:01:38,605 DEBUG [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/f1 2023-02-16 06:01:38,605 DEBUG [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/f1 2023-02-16 06:01:38,605 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,605 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0011662b3ea8e0ef912d56a4c6bada8 columnFamilyName f1 2023-02-16 06:01:38,606 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(310): Store=a0011662b3ea8e0ef912d56a4c6bada8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,606 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,607 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1 2023-02-16 06:01:38,607 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1 2023-02-16 06:01:38,607 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19c8b1cd01ba9b6f5d03b847e096f74 columnFamilyName f1 2023-02-16 06:01:38,608 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(310): Store=d19c8b1cd01ba9b6f5d03b847e096f74/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,608 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,608 DEBUG [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/f2 2023-02-16 06:01:38,609 DEBUG [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/f2 2023-02-16 06:01:38,610 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2 2023-02-16 06:01:38,610 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2 2023-02-16 06:01:38,610 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19c8b1cd01ba9b6f5d03b847e096f74 columnFamilyName f2 2023-02-16 06:01:38,610 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0011662b3ea8e0ef912d56a4c6bada8 columnFamilyName f2 2023-02-16 06:01:38,611 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(310): Store=a0011662b3ea8e0ef912d56a4c6bada8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,611 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(310): Store=d19c8b1cd01ba9b6f5d03b847e096f74/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:38,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:38,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a0011662b3ea8e0ef912d56a4c6bada8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62229911, jitterRate=-0.0727020651102066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:38,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d19c8b1cd01ba9b6f5d03b847e096f74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74990711, jitterRate=0.11744867265224457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8., pid=27, masterSystemTime=1676527298513 2023-02-16 06:01:38,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:38,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74., pid=22, masterSystemTime=1676527298500 2023-02-16 06:01:38,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:38,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 66405203c3668dfd93dda67bb3aee13a, NAME => 'testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 06:01:38,621 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a0011662b3ea8e0ef912d56a4c6bada8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:38,621 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676527298621"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298621"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298621"}]},"ts":"1676527298621"} 2023-02-16 06:01:38,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:38,622 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d19c8b1cd01ba9b6f5d03b847e096f74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:38,622 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298622"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298622"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298622"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298622"}]},"ts":"1676527298622"} 2023-02-16 06:01:38,623 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,624 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1 2023-02-16 06:01:38,625 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1 2023-02-16 06:01:38,625 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66405203c3668dfd93dda67bb3aee13a columnFamilyName f1 2023-02-16 06:01:38,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-16 06:01:38,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure a0011662b3ea8e0ef912d56a4c6bada8, server=jenkins-hbase4.apache.org,38171,1676527296661 in 263 msec 2023-02-16 06:01:38,626 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(310): Store=66405203c3668dfd93dda67bb3aee13a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,626 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,627 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2 2023-02-16 06:01:38,627 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2 2023-02-16 06:01:38,628 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66405203c3668dfd93dda67bb3aee13a columnFamilyName f2 2023-02-16 06:01:38,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a0011662b3ea8e0ef912d56a4c6bada8, ASSIGN in 439 msec 2023-02-16 06:01:38,628 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(310): Store=66405203c3668dfd93dda67bb3aee13a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:38,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-16 06:01:38,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure d19c8b1cd01ba9b6f5d03b847e096f74, server=jenkins-hbase4.apache.org,38755,1676527296696 in 278 msec 2023-02-16 06:01:38,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d19c8b1cd01ba9b6f5d03b847e096f74, ASSIGN in 443 msec 2023-02-16 06:01:38,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:38,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:38,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:38,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 66405203c3668dfd93dda67bb3aee13a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60881570, jitterRate=-0.09279391169548035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:38,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:38,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a., pid=28, masterSystemTime=1676527298513 2023-02-16 06:01:38,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=66405203c3668dfd93dda67bb3aee13a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:38,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676527298638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527298638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527298638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527298638"}]},"ts":"1676527298638"} 2023-02-16 06:01:38,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-16 06:01:38,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 66405203c3668dfd93dda67bb3aee13a, server=jenkins-hbase4.apache.org,38171,1676527296661 in 270 msec 2023-02-16 06:01:38,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-02-16 06:01:38,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=66405203c3668dfd93dda67bb3aee13a, ASSIGN in 455 msec 2023-02-16 06:01:38,643 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:38,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527298643"}]},"ts":"1676527298643"} 2023-02-16 06:01:38,644 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 06:01:38,647 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:38,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 603 msec 2023-02-16 06:01:38,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:38,656 INFO [Listener at localhost/45879] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 06:01:38,656 DEBUG [Listener at localhost/45879] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 06:01:38,656 INFO [Listener at localhost/45879] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:38,660 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 06:01:38,661 INFO [Listener at localhost/45879] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:38,661 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 06:01:38,661 INFO [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:01:38,719 DEBUG [hconnection-0x8a6588f-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:38,737 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38171] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:38,738 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:38,751 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:38,836 INFO [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:01:38,837 INFO [Listener at localhost/45879] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:01:38,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:01:38,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527298838 (current time:1676527298838). 2023-02-16 06:01:38,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:01:38,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] zookeeper.ReadOnlyZKClient(139): Connect 0x41438d2a to 127.0.0.1:61721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:38,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@435bd283, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:38,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:38,851 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51240, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:38,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41438d2a to 127.0.0.1:61721 2023-02-16 06:01:38,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:38,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:01:38,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:01:38,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:01:38,856 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:01:38,856 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676527898856 2023-02-16 06:01:38,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:01:38,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 06:01:38,858 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:38,858 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:01:38,859 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:01:38,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:01:38,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-16 06:01:38,861 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:01:38,862 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676527898862 2023-02-16 06:01:38,958 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:38,960 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:01:39,161 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:39,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:39,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:39,163 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 06:01:39,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,283 INFO [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-16 06:01:39,283 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:39,283 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-16 06:01:39,283 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-16 06:01:39,284 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,284 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,285 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,285 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:39,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:39,286 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,286 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,286 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,286 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 06:01:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 06:01:39,288 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:39,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 06:01:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,289 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 06:01:39,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,293 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 06:01:39,293 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:39,294 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 06:01:39,294 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 06:01:39,294 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 06:01:39,294 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:39,294 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38171,1676527296661' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 06:01:39,295 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 06:01:39,295 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 06:01:39,295 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38755,1676527296696' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 06:01:39,297 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,297 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,297 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:39,298 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,298 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38171,1676527296661' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 06:01:39,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d2de37c[Count = 1] remaining members to acquire global barrier 2023-02-16 06:01:39,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:39,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:39,307 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:39,307 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:39,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38755,1676527296696' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 06:01:39,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d2de37c[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:39,309 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-16 06:01:39,309 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,311 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:39,311 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:39,312 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:39,312 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,312 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. started... 2023-02-16 06:01:39,312 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:39,314 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:39,314 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. started... 2023-02-16 06:01:39,317 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3a52269a5f08aea7e535029b1f2c0642 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 06:01:39,317 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 06:01:39,317 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:39,317 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:39,318 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. started... 2023-02-16 06:01:39,318 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:39,318 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. started... 2023-02-16 06:01:39,319 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5f6f56372f62ae23503f9035d0f5207e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:39,319 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:39,319 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:39,319 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. started... 2023-02-16 06:01:39,319 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4fdd91f4e78271f962e0bbf89e0e537f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:39,319 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,320 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:39,320 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,319 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 06:01:39,320 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:39,320 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,320 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,324 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:39,324 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:39,324 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. started... 2023-02-16 06:01:39,324 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:39,324 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:39,325 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4d5ef427dbe8835395a8e54e1a52c91c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:39,329 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:39,366 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f1/e4f9fc57ebdd4af59331b5cd9e8c3965 2023-02-16 06:01:39,397 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. completed. 2023-02-16 06:01:39,397 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:39,397 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:39,397 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 06:01:39,397 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. started... 2023-02-16 06:01:39,401 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a1e7630ab1b0edfa00cd1a51f560840c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:39,402 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f1/a59328eba4e64526a82962ed0fcdc314 2023-02-16 06:01:39,428 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f1/af9dc81e4c7c42a091682126125cd9b7 2023-02-16 06:01:39,428 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f1/b6009167a29f47e78b9c49ee494de0c0 2023-02-16 06:01:39,455 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f2/e2b950d5cb8c4d5582e5e5003eb17238 2023-02-16 06:01:39,455 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. completed. 2023-02-16 06:01:39,455 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:39,455 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:39,455 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 06:01:39,456 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. started... 2023-02-16 06:01:39,456 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b75faf2c1d6968e78e6d32f5d886762f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:39,462 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f1/e4f9fc57ebdd4af59331b5cd9e8c3965 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/e4f9fc57ebdd4af59331b5cd9e8c3965 2023-02-16 06:01:39,463 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:39,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:39,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:39,465 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 06:01:39,481 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/e4f9fc57ebdd4af59331b5cd9e8c3965, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:39,482 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f2/e2b950d5cb8c4d5582e5e5003eb17238 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/e2b950d5cb8c4d5582e5e5003eb17238 2023-02-16 06:01:39,496 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f2/2947c1e3cc0c40ee9cce7dbadb2cdac3 2023-02-16 06:01:39,504 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/e2b950d5cb8c4d5582e5e5003eb17238, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:39,506 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3a52269a5f08aea7e535029b1f2c0642 in 189ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,506 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/e4f9fc57ebdd4af59331b5cd9e8c3965] hfiles 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/e4f9fc57ebdd4af59331b5cd9e8c3965 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/e2b950d5cb8c4d5582e5e5003eb17238] hfiles 2023-02-16 06:01:39,507 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/e2b950d5cb8c4d5582e5e5003eb17238 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,508 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f2/2e4cfd5995c64d0c930cf367cbed990e 2023-02-16 06:01:39,509 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f1/a59328eba4e64526a82962ed0fcdc314 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/a59328eba4e64526a82962ed0fcdc314 2023-02-16 06:01:39,516 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f1/af9dc81e4c7c42a091682126125cd9b7 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/af9dc81e4c7c42a091682126125cd9b7 2023-02-16 06:01:39,521 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f1/c0c3c906a73846aba32ba397cbf39d10 2023-02-16 06:01:39,524 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:01:39,547 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/a59328eba4e64526a82962ed0fcdc314, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,550 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/af9dc81e4c7c42a091682126125cd9b7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,551 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f2/2947c1e3cc0c40ee9cce7dbadb2cdac3 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/2947c1e3cc0c40ee9cce7dbadb2cdac3 2023-02-16 06:01:39,556 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f2/2e4cfd5995c64d0c930cf367cbed990e as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/2e4cfd5995c64d0c930cf367cbed990e 2023-02-16 06:01:39,564 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. completed. 2023-02-16 06:01:39,567 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:39,567 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:39,567 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 06:01:39,567 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. started... 2023-02-16 06:01:39,569 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d19c8b1cd01ba9b6f5d03b847e096f74 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 06:01:39,573 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/2947c1e3cc0c40ee9cce7dbadb2cdac3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,574 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4fdd91f4e78271f962e0bbf89e0e537f in 255ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/a59328eba4e64526a82962ed0fcdc314] hfiles 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/a59328eba4e64526a82962ed0fcdc314 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/2947c1e3cc0c40ee9cce7dbadb2cdac3] hfiles 2023-02-16 06:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/2947c1e3cc0c40ee9cce7dbadb2cdac3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,581 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/2e4cfd5995c64d0c930cf367cbed990e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,584 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4d5ef427dbe8835395a8e54e1a52c91c in 259ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,584 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:39,584 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,584 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,584 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/af9dc81e4c7c42a091682126125cd9b7] hfiles 2023-02-16 06:01:39,584 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/af9dc81e4c7c42a091682126125cd9b7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,585 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/2e4cfd5995c64d0c930cf367cbed990e] hfiles 2023-02-16 06:01:39,585 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/2e4cfd5995c64d0c930cf367cbed990e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,589 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f2/441f16a2391c454380d30333fb4a2391 2023-02-16 06:01:39,595 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f1/c0c3c906a73846aba32ba397cbf39d10 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/c0c3c906a73846aba32ba397cbf39d10 2023-02-16 06:01:39,607 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/c0c3c906a73846aba32ba397cbf39d10, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,613 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f2/441f16a2391c454380d30333fb4a2391 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/441f16a2391c454380d30333fb4a2391 2023-02-16 06:01:39,626 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. completed. 2023-02-16 06:01:39,627 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:39,627 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 06:01:39,627 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. started... 2023-02-16 06:01:39,627 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 66405203c3668dfd93dda67bb3aee13a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:39,631 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/441f16a2391c454380d30333fb4a2391, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,632 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b75faf2c1d6968e78e6d32f5d886762f in 176ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/c0c3c906a73846aba32ba397cbf39d10] hfiles 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/c0c3c906a73846aba32ba397cbf39d10 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/441f16a2391c454380d30333fb4a2391] hfiles 2023-02-16 06:01:39,632 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/441f16a2391c454380d30333fb4a2391 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,640 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. completed. 2023-02-16 06:01:39,640 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:39,640 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 06:01:39,641 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f1/dfbe9265df6742adb7a720ec96719456 2023-02-16 06:01:39,680 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f1/f9bda6ec013b4613982f0a0d0c1eed88 2023-02-16 06:01:39,681 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. completed. 2023-02-16 06:01:39,681 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:39,681 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 06:01:39,712 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f2/0825a23a72fc4a139a19e5d951cb27f6 2023-02-16 06:01:39,720 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f1/dfbe9265df6742adb7a720ec96719456 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/dfbe9265df6742adb7a720ec96719456 2023-02-16 06:01:39,726 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/dfbe9265df6742adb7a720ec96719456, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:39,727 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f2/bbd7b1671f82431e9ac502f70ae7a098 2023-02-16 06:01:39,728 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f2/0825a23a72fc4a139a19e5d951cb27f6 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/0825a23a72fc4a139a19e5d951cb27f6 2023-02-16 06:01:39,740 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/0825a23a72fc4a139a19e5d951cb27f6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:39,741 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f1/f9bda6ec013b4613982f0a0d0c1eed88 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/f9bda6ec013b4613982f0a0d0c1eed88 2023-02-16 06:01:39,741 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d19c8b1cd01ba9b6f5d03b847e096f74 in 172ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,741 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:39,742 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,742 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,742 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/dfbe9265df6742adb7a720ec96719456] hfiles 2023-02-16 06:01:39,742 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/dfbe9265df6742adb7a720ec96719456 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,742 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/0825a23a72fc4a139a19e5d951cb27f6] hfiles 2023-02-16 06:01:39,742 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/0825a23a72fc4a139a19e5d951cb27f6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,751 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/f9bda6ec013b4613982f0a0d0c1eed88, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,753 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f2/bbd7b1671f82431e9ac502f70ae7a098 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/bbd7b1671f82431e9ac502f70ae7a098 2023-02-16 06:01:39,772 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/bbd7b1671f82431e9ac502f70ae7a098, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,773 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 66405203c3668dfd93dda67bb3aee13a in 146ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,773 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:39,773 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,773 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,773 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/f9bda6ec013b4613982f0a0d0c1eed88] hfiles 2023-02-16 06:01:39,774 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/f9bda6ec013b4613982f0a0d0c1eed88 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,774 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/bbd7b1671f82431e9ac502f70ae7a098] hfiles 2023-02-16 06:01:39,774 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/bbd7b1671f82431e9ac502f70ae7a098 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,796 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. completed. 2023-02-16 06:01:39,796 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:39,796 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 06:01:39,818 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. completed. 2023-02-16 06:01:39,818 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:39,818 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 06:01:39,902 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f1/039b87697f744de69854ade660c3b86b 2023-02-16 06:01:39,924 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f2/d2508fc9adc94f16a4f25e590657f9e5 2023-02-16 06:01:39,931 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f1/039b87697f744de69854ade660c3b86b as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/039b87697f744de69854ade660c3b86b 2023-02-16 06:01:39,937 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/039b87697f744de69854ade660c3b86b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,938 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f2/d2508fc9adc94f16a4f25e590657f9e5 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/d2508fc9adc94f16a4f25e590657f9e5 2023-02-16 06:01:39,938 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f2/ab800399a33449d1abacba4baeb7c351 2023-02-16 06:01:39,943 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/d2508fc9adc94f16a4f25e590657f9e5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,944 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a1e7630ab1b0edfa00cd1a51f560840c in 544ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/039b87697f744de69854ade660c3b86b] hfiles 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/039b87697f744de69854ade660c3b86b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/d2508fc9adc94f16a4f25e590657f9e5] hfiles 2023-02-16 06:01:39,944 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/d2508fc9adc94f16a4f25e590657f9e5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,947 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f1/b6009167a29f47e78b9c49ee494de0c0 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/b6009167a29f47e78b9c49ee494de0c0 2023-02-16 06:01:39,952 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/b6009167a29f47e78b9c49ee494de0c0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,953 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f2/ab800399a33449d1abacba4baeb7c351 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/ab800399a33449d1abacba4baeb7c351 2023-02-16 06:01:39,958 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/ab800399a33449d1abacba4baeb7c351, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:39,959 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5f6f56372f62ae23503f9035d0f5207e in 642ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:39,959 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:39,959 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,959 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:39,959 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/b6009167a29f47e78b9c49ee494de0c0] hfiles 2023-02-16 06:01:39,959 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/b6009167a29f47e78b9c49ee494de0c0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,960 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/ab800399a33449d1abacba4baeb7c351] hfiles 2023-02-16 06:01:39,960 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/ab800399a33449d1abacba4baeb7c351 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,965 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:39,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:39,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:39,968 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. completed. 2023-02-16 06:01:39,968 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-16 06:01:39,968 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:39,968 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 06:01:39,969 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 06:01:39,969 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,969 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 06:01:39,969 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,38171,1676527296661' in zk 2023-02-16 06:01:39,971 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:39,971 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 06:01:39,972 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:39,972 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 06:01:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,38171,1676527296661': 2023-02-16 06:01:39,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38171,1676527296661' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 06:01:39,981 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. completed. 2023-02-16 06:01:39,981 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 06:01:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 06:01:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 06:01:39,981 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,38755,1676527296696' in zk 2023-02-16 06:01:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 06:01:39,983 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:39,983 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 06:01:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,38755,1676527296696': 2023-02-16 06:01:39,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38755,1676527296696' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 06:01:39,989 INFO [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-16 06:01:39,989 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:39,989 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:39,989 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,989 INFO [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:01:39,991 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,991 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,991 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:39,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,991 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,991 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:39,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:39,992 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:39,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,993 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,996 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:39,996 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:39,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:39,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:39,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:40,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,005 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:40,005 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,005 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,004 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:40,005 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:40,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:40,005 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:40,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:40,008 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:40,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:40,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-16 06:01:40,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,331 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:40,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676527298857Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676527300008 (+1151 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676527300009 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676527300034 (+25 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676527300053 (+19 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676527300330 (+277 ms) 2023-02-16 06:01:40,332 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:01:40,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.4740 sec 2023-02-16 06:01:40,968 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:40,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:01:40,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:01:40,970 INFO [Listener at localhost/45879] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:01:40,975 INFO [Listener at localhost/45879] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:01:40,984 INFO [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:01:41,033 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38171] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,035 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38755] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,143 INFO [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:01:41,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:01:41,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 06:01:41,156 INFO [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 06:01:41,157 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:41,158 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 06:01:41,158 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 06:01:41,158 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,158 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,160 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:41,160 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:41,160 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,161 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,161 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,161 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,162 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:41,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,162 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 06:01:41,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 06:01:41,162 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 06:01:41,162 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:41,163 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 06:01:41,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,164 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 06:01:41,168 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,168 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. started... 2023-02-16 06:01:41,168 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4fdd91f4e78271f962e0bbf89e0e537f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:41,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 06:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 06:01:41,173 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:41,177 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,177 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 06:01:41,177 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:41,177 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 06:01:41,177 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,177 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. started... 2023-02-16 06:01:41,177 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4d5ef427dbe8835395a8e54e1a52c91c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:41,177 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. started... 2023-02-16 06:01:41,179 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,180 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. started... 2023-02-16 06:01:41,180 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f6f56372f62ae23503f9035d0f5207e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:41,179 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,180 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:41,182 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,182 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. started... 2023-02-16 06:01:41,184 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3a52269a5f08aea7e535029b1f2c0642 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 06:01:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 06:01:41,188 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 06:01:41,188 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,188 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. started... 2023-02-16 06:01:41,188 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:41,188 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. started... 2023-02-16 06:01:41,192 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:41,192 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a1e7630ab1b0edfa00cd1a51f560840c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:41,192 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,192 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,192 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. started... 2023-02-16 06:01:41,192 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b75faf2c1d6968e78e6d32f5d886762f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:41,194 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 06:01:41,227 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f1/fb2017f636bf4a9ca2db8e06c8e54a71 2023-02-16 06:01:41,239 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f1/355e6db87c6740aea77957a9ea8cbef5 2023-02-16 06:01:41,243 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f1/aa8e50f5543e44339aa075aa06c4bf35 2023-02-16 06:01:41,262 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f1/7ae7a5a005be43e692882faf59ccac09 2023-02-16 06:01:41,273 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f2/34225307cf0a420d9c46d390d86fd786 2023-02-16 06:01:41,276 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f1/27b97b22bd8d4952924fbd94d1d24ad3 2023-02-16 06:01:41,280 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f1/fb2017f636bf4a9ca2db8e06c8e54a71 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/fb2017f636bf4a9ca2db8e06c8e54a71 2023-02-16 06:01:41,280 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f1/1270c28aff9446898f6c27fb01b01ece 2023-02-16 06:01:41,287 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/fb2017f636bf4a9ca2db8e06c8e54a71, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,288 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/.tmp/f2/34225307cf0a420d9c46d390d86fd786 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/34225307cf0a420d9c46d390d86fd786 2023-02-16 06:01:41,293 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/34225307cf0a420d9c46d390d86fd786, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,294 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4fdd91f4e78271f962e0bbf89e0e537f in 126ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,295 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:41,295 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,295 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,295 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 06:01:41,295 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. started... 2023-02-16 06:01:41,295 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 66405203c3668dfd93dda67bb3aee13a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:41,299 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f2/b535d5a03ee94ff8b415e94c4f5f6c7b 2023-02-16 06:01:41,304 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f2/efb155fada5f46a0a5163c23d61b9a52 2023-02-16 06:01:41,316 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f1/aa8e50f5543e44339aa075aa06c4bf35 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/aa8e50f5543e44339aa075aa06c4bf35 2023-02-16 06:01:41,322 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/aa8e50f5543e44339aa075aa06c4bf35, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,323 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/.tmp/f2/efb155fada5f46a0a5163c23d61b9a52 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/efb155fada5f46a0a5163c23d61b9a52 2023-02-16 06:01:41,324 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f2/006ebd8611b9441bb21c426d2061f64e 2023-02-16 06:01:41,327 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f1/355e6db87c6740aea77957a9ea8cbef5 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/355e6db87c6740aea77957a9ea8cbef5 2023-02-16 06:01:41,331 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/efb155fada5f46a0a5163c23d61b9a52, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,333 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5f6f56372f62ae23503f9035d0f5207e in 153ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,333 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:41,333 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,333 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,333 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f2/abe5ddccfcd0413b8df8348a4ce1704b 2023-02-16 06:01:41,333 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/355e6db87c6740aea77957a9ea8cbef5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 06:01:41,333 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. started... 2023-02-16 06:01:41,334 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d19c8b1cd01ba9b6f5d03b847e096f74 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 06:01:41,335 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f1/7ae7a5a005be43e692882faf59ccac09 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/7ae7a5a005be43e692882faf59ccac09 2023-02-16 06:01:41,335 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/.tmp/f2/b535d5a03ee94ff8b415e94c4f5f6c7b as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/b535d5a03ee94ff8b415e94c4f5f6c7b 2023-02-16 06:01:41,341 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f1/27b97b22bd8d4952924fbd94d1d24ad3 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/27b97b22bd8d4952924fbd94d1d24ad3 2023-02-16 06:01:41,341 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/b535d5a03ee94ff8b415e94c4f5f6c7b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,342 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4d5ef427dbe8835395a8e54e1a52c91c in 165ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,342 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:41,342 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 06:01:41,344 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f2/9b5bf9c249484da5a5aa1205144e9966 2023-02-16 06:01:41,362 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/7ae7a5a005be43e692882faf59ccac09, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,363 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/.tmp/f2/006ebd8611b9441bb21c426d2061f64e as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/006ebd8611b9441bb21c426d2061f64e 2023-02-16 06:01:41,377 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/27b97b22bd8d4952924fbd94d1d24ad3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,380 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/.tmp/f2/abe5ddccfcd0413b8df8348a4ce1704b as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/abe5ddccfcd0413b8df8348a4ce1704b 2023-02-16 06:01:41,384 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f1/bba35eabc529412c91f32b92e91bf4aa 2023-02-16 06:01:41,391 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f1/1270c28aff9446898f6c27fb01b01ece as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/1270c28aff9446898f6c27fb01b01ece 2023-02-16 06:01:41,397 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/006ebd8611b9441bb21c426d2061f64e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,397 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/1270c28aff9446898f6c27fb01b01ece, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:41,398 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/.tmp/f2/9b5bf9c249484da5a5aa1205144e9966 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/9b5bf9c249484da5a5aa1205144e9966 2023-02-16 06:01:41,399 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b75faf2c1d6968e78e6d32f5d886762f in 207ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,399 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:41,399 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,399 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 06:01:41,400 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/abe5ddccfcd0413b8df8348a4ce1704b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,401 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a1e7630ab1b0edfa00cd1a51f560840c in 209ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,401 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:41,401 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,401 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 06:01:41,405 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/9b5bf9c249484da5a5aa1205144e9966, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:41,405 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3a52269a5f08aea7e535029b1f2c0642 in 221ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,406 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:41,406 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,406 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 06:01:41,408 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f1/bb95319f83154ad39fe89e272df715ba 2023-02-16 06:01:41,427 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f2/ea99f596f21342ee91a26363f5e9b375 2023-02-16 06:01:41,434 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f1/bba35eabc529412c91f32b92e91bf4aa as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/bba35eabc529412c91f32b92e91bf4aa 2023-02-16 06:01:41,435 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f2/e95f02111e794b538d7ac4b4a1c8a81a 2023-02-16 06:01:41,440 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/bba35eabc529412c91f32b92e91bf4aa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,442 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/.tmp/f2/ea99f596f21342ee91a26363f5e9b375 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/ea99f596f21342ee91a26363f5e9b375 2023-02-16 06:01:41,442 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f1/bb95319f83154ad39fe89e272df715ba as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/bb95319f83154ad39fe89e272df715ba 2023-02-16 06:01:41,449 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/ea99f596f21342ee91a26363f5e9b375, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:41,450 INFO [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 66405203c3668dfd93dda67bb3aee13a in 155ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,450 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:41,450 DEBUG [rs(jenkins-hbase4.apache.org,38171,1676527296661)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 06:01:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 06:01:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 06:01:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38171,1676527296661' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 06:01:41,452 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,452 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:41,452 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/bb95319f83154ad39fe89e272df715ba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:41,453 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,453 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:41,453 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/.tmp/f2/e95f02111e794b538d7ac4b4a1c8a81a as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/e95f02111e794b538d7ac4b4a1c8a81a 2023-02-16 06:01:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:41,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38171,1676527296661' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 06:01:41,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59126c01[Count = 1] remaining members to acquire global barrier 2023-02-16 06:01:41,461 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/e95f02111e794b538d7ac4b4a1c8a81a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:41,462 INFO [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d19c8b1cd01ba9b6f5d03b847e096f74 in 128ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:41,462 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:41,462 DEBUG [rs(jenkins-hbase4.apache.org,38755,1676527296696)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,462 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 06:01:41,462 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 06:01:41,462 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,462 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 06:01:41,462 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38755,1676527296696' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 06:01:41,464 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,464 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:41,464 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,464 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:41,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38755,1676527296696' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 06:01:41,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59126c01[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:41,466 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 06:01:41,466 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,469 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,469 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,469 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 06:01:41,469 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 06:01:41,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,469 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38171,1676527296661' in zk 2023-02-16 06:01:41,469 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,470 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 06:01:41,470 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 06:01:41,470 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38755,1676527296696' in zk 2023-02-16 06:01:41,470 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,470 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:41,472 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 06:01:41,472 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,472 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:41,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,472 DEBUG [member: 'jenkins-hbase4.apache.org,38171,1676527296661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 06:01:41,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:41,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:41,474 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 06:01:41,474 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,474 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:41,474 DEBUG [member: 'jenkins-hbase4.apache.org,38755,1676527296696' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 06:01:41,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:41,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:41,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:41,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38171,1676527296661': 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38171,1676527296661' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:41,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38755,1676527296696': 2023-02-16 06:01:41,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38755,1676527296696' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 06:01:41,481 INFO [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 06:01:41,481 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:41,481 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:41,481 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 06:01:41,481 INFO [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:01:41,483 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,483 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:41,483 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:41,483 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,483 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:41,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:41,484 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:41,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,485 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,487 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:41,488 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:01:41,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,492 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:41,492 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:41,492 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:41,492 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:41,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:41,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,493 DEBUG [(jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:01:41,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:01:41,493 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:01:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:41,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:41,495 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:41,495 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:01:41,595 DEBUG [Listener at localhost/45879] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:01:41,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:01:41,597 INFO [Listener at localhost/45879] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:01:41,597 DEBUG [Listener at localhost/45879] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bcefeab to 127.0.0.1:61721 2023-02-16 06:01:41,598 DEBUG [Listener at localhost/45879] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,598 DEBUG [Listener at localhost/45879] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:01:41,598 DEBUG [Listener at localhost/45879] util.JVMClusterUtil(257): Found active master hash=2010544539, stopped=false 2023-02-16 06:01:41,598 INFO [Listener at localhost/45879] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:41,601 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:41,601 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:41,601 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:41,601 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:41,601 INFO [Listener at localhost/45879] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:01:41,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:41,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:41,603 DEBUG [Listener at localhost/45879] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50ce60fb to 127.0.0.1:61721 2023-02-16 06:01:41,603 DEBUG [Listener at localhost/45879] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:41,603 INFO [Listener at localhost/45879] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38171,1676527296661' ***** 2023-02-16 06:01:41,603 INFO [Listener at localhost/45879] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:41,603 INFO [Listener at localhost/45879] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38755,1676527296696' ***** 2023-02-16 06:01:41,603 INFO [RS:0;jenkins-hbase4:38171] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:41,604 INFO [RS:0;jenkins-hbase4:38171] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:41,603 INFO [Listener at localhost/45879] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:41,604 INFO [RS:0;jenkins-hbase4:38171] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:41,604 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:41,604 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:41,605 INFO [RS:1;jenkins-hbase4:38755] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:41,604 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(3304): Received CLOSE for 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:41,605 INFO [RS:1;jenkins-hbase4:38755] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:41,605 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:41,605 INFO [RS:1;jenkins-hbase4:38755] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:41,606 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(3304): Received CLOSE for a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:41,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fdd91f4e78271f962e0bbf89e0e537f, disabling compactions & flushes 2023-02-16 06:01:41,606 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(3304): Received CLOSE for 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:41,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,606 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(3304): Received CLOSE for a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:41,606 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(3304): Received CLOSE for d04e1d9bf6632ad198be14dfa446178e 2023-02-16 06:01:41,606 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(3304): Received CLOSE for 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:41,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,606 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. after waiting 0 ms 2023-02-16 06:01:41,606 DEBUG [RS:0;jenkins-hbase4:38171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bb7c21a to 127.0.0.1:61721 2023-02-16 06:01:41,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,606 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(3304): Received CLOSE for 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:41,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d04e1d9bf6632ad198be14dfa446178e, disabling compactions & flushes 2023-02-16 06:01:41,606 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(3304): Received CLOSE for 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:41,606 DEBUG [RS:0;jenkins-hbase4:38171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,607 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(3304): Received CLOSE for 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:41,607 INFO [RS:0;jenkins-hbase4:38171] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:41,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:41,607 INFO [RS:0;jenkins-hbase4:38171] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:41,607 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(3304): Received CLOSE for b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:41,609 INFO [RS:0;jenkins-hbase4:38171] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:41,609 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(3304): Received CLOSE for d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:41,609 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:01:41,609 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:41,609 DEBUG [RS:1;jenkins-hbase4:38755] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c3fe881 to 127.0.0.1:61721 2023-02-16 06:01:41,610 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-16 06:01:41,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. after waiting 0 ms 2023-02-16 06:01:41,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:41,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:41,610 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1479): Online Regions={4fdd91f4e78271f962e0bbf89e0e537f=testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f., a0011662b3ea8e0ef912d56a4c6bada8=testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8., 4d5ef427dbe8835395a8e54e1a52c91c=testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c., 1588230740=hbase:meta,,1.1588230740, a1e7630ab1b0edfa00cd1a51f560840c=testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c., 66405203c3668dfd93dda67bb3aee13a=testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.} 2023-02-16 06:01:41,610 DEBUG [RS:1;jenkins-hbase4:38755] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:41,610 DEBUG [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1505): Waiting on 1588230740, 4d5ef427dbe8835395a8e54e1a52c91c, 4fdd91f4e78271f962e0bbf89e0e537f, 66405203c3668dfd93dda67bb3aee13a, a0011662b3ea8e0ef912d56a4c6bada8, a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:41,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d04e1d9bf6632ad198be14dfa446178e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:01:41,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:41,610 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-16 06:01:41,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:41,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:41,611 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1479): Online Regions={d04e1d9bf6632ad198be14dfa446178e=hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e., 5f6f56372f62ae23503f9035d0f5207e=testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e., 3a52269a5f08aea7e535029b1f2c0642=testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642., 117fbd5126f592bcfc584d2acebefd49=testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49., b75faf2c1d6968e78e6d32f5d886762f=testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f., d19c8b1cd01ba9b6f5d03b847e096f74=testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.} 2023-02-16 06:01:41,613 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-16 06:01:41,614 DEBUG [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1505): Waiting on 117fbd5126f592bcfc584d2acebefd49, 3a52269a5f08aea7e535029b1f2c0642, 5f6f56372f62ae23503f9035d0f5207e, b75faf2c1d6968e78e6d32f5d886762f, d04e1d9bf6632ad198be14dfa446178e, d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:41,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a0011662b3ea8e0ef912d56a4c6bada8, disabling compactions & flushes 2023-02-16 06:01:41,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. after waiting 0 ms 2023-02-16 06:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 06:01:41,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:41,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d5ef427dbe8835395a8e54e1a52c91c, disabling compactions & flushes 2023-02-16 06:01:41,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. after waiting 0 ms 2023-02-16 06:01:41,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/.tmp/info/dcbe03ab57744c1ea5efc150f4e217ca 2023-02-16 06:01:41,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/.tmp/info/641c112fae6c4c388eff582055a2e507 2023-02-16 06:01:41,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/.tmp/info/dcbe03ab57744c1ea5efc150f4e217ca as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/info/dcbe03ab57744c1ea5efc150f4e217ca 2023-02-16 06:01:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a1e7630ab1b0edfa00cd1a51f560840c, disabling compactions & flushes 2023-02-16 06:01:41,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. after waiting 0 ms 2023-02-16 06:01:41,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/info/dcbe03ab57744c1ea5efc150f4e217ca, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:01:41,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d04e1d9bf6632ad198be14dfa446178e in 48ms, sequenceid=6, compaction requested=false 2023-02-16 06:01:41,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 06:01:41,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/namespace/d04e1d9bf6632ad198be14dfa446178e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:01:41,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d04e1d9bf6632ad198be14dfa446178e: 2023-02-16 06:01:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527297442.d04e1d9bf6632ad198be14dfa446178e. 2023-02-16 06:01:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5f6f56372f62ae23503f9035d0f5207e, disabling compactions & flushes 2023-02-16 06:01:41,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. after waiting 0 ms 2023-02-16 06:01:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/.tmp/table/27cd3850dec6410ebd53dc18186851fd 2023-02-16 06:01:41,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/.tmp/info/641c112fae6c4c388eff582055a2e507 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/info/641c112fae6c4c388eff582055a2e507 2023-02-16 06:01:41,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:41,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:41,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3a52269a5f08aea7e535029b1f2c0642, disabling compactions & flushes 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:41,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. after waiting 0 ms 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 66405203c3668dfd93dda67bb3aee13a, disabling compactions & flushes 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. after waiting 0 ms 2023-02-16 06:01:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/info/641c112fae6c4c388eff582055a2e507, entries=110, sequenceid=32, filesize=18.7 K 2023-02-16 06:01:41,702 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/.tmp/table/27cd3850dec6410ebd53dc18186851fd as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/table/27cd3850dec6410ebd53dc18186851fd 2023-02-16 06:01:41,703 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:41,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/table/27cd3850dec6410ebd53dc18186851fd, entries=4, sequenceid=32, filesize=4.8 K 2023-02-16 06:01:41,709 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 97ms, sequenceid=32, compaction requested=false 2023-02-16 06:01:41,709 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 06:01:41,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:41,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:41,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:41,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:41,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 117fbd5126f592bcfc584d2acebefd49, disabling compactions & flushes 2023-02-16 06:01:41,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. after waiting 0 ms 2023-02-16 06:01:41,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,719 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-16 06:01:41,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 06:01:41,720 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:01:41,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:41,720 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:41,720 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:41,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:41,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:41,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b75faf2c1d6968e78e6d32f5d886762f, disabling compactions & flushes 2023-02-16 06:01:41,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. after waiting 0 ms 2023-02-16 06:01:41,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:41,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:41,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d19c8b1cd01ba9b6f5d03b847e096f74, disabling compactions & flushes 2023-02-16 06:01:41,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. after waiting 0 ms 2023-02-16 06:01:41,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:41,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:41,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:41,811 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38171,1676527296661; all regions closed. 2023-02-16 06:01:41,814 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38755,1676527296696; all regions closed. 2023-02-16 06:01:41,818 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/WALs/jenkins-hbase4.apache.org,38755,1676527296696/jenkins-hbase4.apache.org%2C38755%2C1676527296696.1676527297816 not finished, retry = 0 2023-02-16 06:01:41,824 DEBUG [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/oldWALs 2023-02-16 06:01:41,825 INFO [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38171%2C1676527296661.meta:.meta(num 1676527297371) 2023-02-16 06:01:41,831 DEBUG [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/oldWALs 2023-02-16 06:01:41,831 INFO [RS:0;jenkins-hbase4:38171] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38171%2C1676527296661:(num 1676527298091) 2023-02-16 06:01:41,831 DEBUG [RS:0;jenkins-hbase4:38171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,831 INFO [RS:0;jenkins-hbase4:38171] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:41,832 INFO [RS:0;jenkins-hbase4:38171] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:41,832 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:41,833 INFO [RS:0;jenkins-hbase4:38171] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38171 2023-02-16 06:01:41,835 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,835 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38171,1676527296661 2023-02-16 06:01:41,835 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:41,836 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:41,836 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bd7a430 rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:41,835 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:41,837 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38171,1676527296661] 2023-02-16 06:01:41,837 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38171,1676527296661; numProcessing=1 2023-02-16 06:01:41,840 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38171,1676527296661 already deleted, retry=false 2023-02-16 06:01:41,840 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38171,1676527296661 expired; onlineServers=1 2023-02-16 06:01:41,921 DEBUG [RS:1;jenkins-hbase4:38755] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/oldWALs 2023-02-16 06:01:41,921 INFO [RS:1;jenkins-hbase4:38755] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38755%2C1676527296696:(num 1676527297816) 2023-02-16 06:01:41,921 DEBUG [RS:1;jenkins-hbase4:38755] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,921 INFO [RS:1;jenkins-hbase4:38755] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:41,921 INFO [RS:1;jenkins-hbase4:38755] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:41,921 INFO [RS:1;jenkins-hbase4:38755] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:41,921 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:41,921 INFO [RS:1;jenkins-hbase4:38755] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:41,921 INFO [RS:1;jenkins-hbase4:38755] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:41,922 INFO [RS:1;jenkins-hbase4:38755] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38755 2023-02-16 06:01:41,926 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:41,926 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38755,1676527296696 2023-02-16 06:01:41,927 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c238b99 rejected from java.util.concurrent.ThreadPoolExecutor@481c16c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:41,928 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38755,1676527296696] 2023-02-16 06:01:41,928 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38755,1676527296696; numProcessing=2 2023-02-16 06:01:41,929 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38755,1676527296696 already deleted, retry=false 2023-02-16 06:01:41,929 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38755,1676527296696 expired; onlineServers=0 2023-02-16 06:01:41,929 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36811,1676527296576' ***** 2023-02-16 06:01:41,929 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:01:41,930 DEBUG [M:0;jenkins-hbase4:36811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36eb73a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:41,930 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36811,1676527296576 2023-02-16 06:01:41,930 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36811,1676527296576; all regions closed. 2023-02-16 06:01:41,930 DEBUG [M:0;jenkins-hbase4:36811] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:41,930 DEBUG [M:0;jenkins-hbase4:36811] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:01:41,930 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:01:41,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527296890] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527296890,5,FailOnTimeoutGroup] 2023-02-16 06:01:41,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527296890] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527296890,5,FailOnTimeoutGroup] 2023-02-16 06:01:41,930 DEBUG [M:0;jenkins-hbase4:36811] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:01:41,933 INFO [M:0;jenkins-hbase4:36811] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:01:41,933 INFO [M:0;jenkins-hbase4:36811] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:01:41,933 INFO [M:0;jenkins-hbase4:36811] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:01:41,933 DEBUG [M:0;jenkins-hbase4:36811] master.HMaster(1512): Stopping service threads 2023-02-16 06:01:41,933 INFO [M:0;jenkins-hbase4:36811] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:01:41,934 ERROR [M:0;jenkins-hbase4:36811] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:01:41,934 INFO [M:0;jenkins-hbase4:36811] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:01:41,934 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:01:42,028 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:42,028 INFO [RS:1;jenkins-hbase4:38755] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38755,1676527296696; zookeeper connection closed. 2023-02-16 06:01:42,029 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c764c61 rejected from java.util.concurrent.ThreadPoolExecutor@481c16c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:42,029 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38755-0x1005bb849e70002, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:42,029 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@145bfe55 rejected from java.util.concurrent.ThreadPoolExecutor@481c16c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:42,030 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@684510aa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@684510aa 2023-02-16 06:01:42,032 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:42,032 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:42,032 INFO [M:0;jenkins-hbase4:36811] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:01:42,033 INFO [M:0;jenkins-hbase4:36811] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:01:42,033 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-16 06:01:42,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:42,033 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-16 06:01:42,033 DEBUG [M:0;jenkins-hbase4:36811] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:42,033 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:42,033 DEBUG [M:0;jenkins-hbase4:36811] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:42,033 DEBUG [M:0;jenkins-hbase4:36811] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:42,033 DEBUG [M:0;jenkins-hbase4:36811] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:42,033 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-16 06:01:42,044 INFO [M:0;jenkins-hbase4:36811] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f4f5ab06343e4e61a522e6d6c851a1b1 2023-02-16 06:01:42,050 DEBUG [M:0;jenkins-hbase4:36811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f4f5ab06343e4e61a522e6d6c851a1b1 as hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f4f5ab06343e4e61a522e6d6c851a1b1 2023-02-16 06:01:42,055 INFO [M:0;jenkins-hbase4:36811] regionserver.HStore(1080): Added hdfs://localhost:38621/user/jenkins/test-data/a1feae3b-ae93-e3b8-47e6-9f70db7d09fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f4f5ab06343e4e61a522e6d6c851a1b1, entries=31, sequenceid=218, filesize=9.0 K 2023-02-16 06:01:42,055 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-16 06:01:42,056 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:42,056 DEBUG [M:0;jenkins-hbase4:36811] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:42,062 INFO [M:0;jenkins-hbase4:36811] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:01:42,063 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:42,063 INFO [M:0;jenkins-hbase4:36811] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36811 2023-02-16 06:01:42,066 DEBUG [M:0;jenkins-hbase4:36811] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36811,1676527296576 already deleted, retry=false 2023-02-16 06:01:42,101 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:42,101 INFO [RS:0;jenkins-hbase4:38171] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38171,1676527296661; zookeeper connection closed. 2023-02-16 06:01:42,101 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4daaaaec rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:42,101 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4758dd3a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4758dd3a 2023-02-16 06:01:42,101 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): regionserver:38171-0x1005bb849e70001, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:42,102 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35502b13 rejected from java.util.concurrent.ThreadPoolExecutor@1fe82392[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:42,102 INFO [Listener at localhost/45879] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:01:42,201 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:42,201 INFO [M:0;jenkins-hbase4:36811] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36811,1676527296576; zookeeper connection closed. 2023-02-16 06:01:42,201 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e434e9a rejected from java.util.concurrent.ThreadPoolExecutor@2a7ccf8a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:42,202 DEBUG [Listener at localhost/45879-EventThread] zookeeper.ZKWatcher(600): master:36811-0x1005bb849e70000, quorum=127.0.0.1:61721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:42,202 ERROR [Listener at localhost/45879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a589ec0 rejected from java.util.concurrent.ThreadPoolExecutor@2a7ccf8a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:42,299 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop-1412380405396273548.jar 2023-02-16 06:01:42,304 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676527298838 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:42,304 DEBUG [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:42,305 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(239): region to add: d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=4fdd91f4e78271f962e0bbf89e0e537f as 4fdd91f4e78271f962e0bbf89e0e537f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=5f6f56372f62ae23503f9035d0f5207e as 5f6f56372f62ae23503f9035d0f5207e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=a0011662b3ea8e0ef912d56a4c6bada8 as a0011662b3ea8e0ef912d56a4c6bada8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=117fbd5126f592bcfc584d2acebefd49 as 117fbd5126f592bcfc584d2acebefd49 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=4d5ef427dbe8835395a8e54e1a52c91c as 4d5ef427dbe8835395a8e54e1a52c91c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=3a52269a5f08aea7e535029b1f2c0642 as 3a52269a5f08aea7e535029b1f2c0642 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,306 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=a1e7630ab1b0edfa00cd1a51f560840c as a1e7630ab1b0edfa00cd1a51f560840c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,307 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=b75faf2c1d6968e78e6d32f5d886762f as b75faf2c1d6968e78e6d32f5d886762f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,307 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=66405203c3668dfd93dda67bb3aee13a as 66405203c3668dfd93dda67bb3aee13a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,307 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(585): clone region=d19c8b1cd01ba9b6f5d03b847e096f74 as d19c8b1cd01ba9b6f5d03b847e096f74 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 06:01:42,308 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fdd91f4e78271f962e0bbf89e0e537f, NAME => 'testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,309 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5f6f56372f62ae23503f9035d0f5207e, NAME => 'testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,310 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4d5ef427dbe8835395a8e54e1a52c91c, NAME => 'testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,310 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3a52269a5f08aea7e535029b1f2c0642, NAME => 'testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,310 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a0011662b3ea8e0ef912d56a4c6bada8, NAME => 'testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,310 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => b75faf2c1d6968e78e6d32f5d886762f, NAME => 'testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,311 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => a1e7630ab1b0edfa00cd1a51f560840c, NAME => 'testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,311 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 117fbd5126f592bcfc584d2acebefd49, NAME => 'testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,324 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,324 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a0011662b3ea8e0ef912d56a4c6bada8, disabling compactions & flushes 2023-02-16 06:01:42,324 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:42,324 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:42,324 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. after waiting 0 ms 2023-02-16 06:01:42,324 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:42,324 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:42,324 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:42,325 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 66405203c3668dfd93dda67bb3aee13a, NAME => 'testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,326 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,326 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a59328eba4e64526a82962ed0fcdc314 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,329 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2947c1e3cc0c40ee9cce7dbadb2cdac3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,334 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4fdd91f4e78271f962e0bbf89e0e537f, disabling compactions & flushes 2023-02-16 06:01:42,334 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:42,334 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:42,334 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. after waiting 0 ms 2023-02-16 06:01:42,334 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:42,334 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,334 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:42,335 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4f9fc57ebdd4af59331b5cd9e8c3965 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,335 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:42,335 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,335 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af9dc81e4c7c42a091682126125cd9b7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,335 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d19c8b1cd01ba9b6f5d03b847e096f74, NAME => 'testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,338 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,338 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c0c3c906a73846aba32ba397cbf39d10 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,338 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,338 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 117fbd5126f592bcfc584d2acebefd49, disabling compactions & flushes 2023-02-16 06:01:42,338 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:42,338 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:42,338 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. after waiting 0 ms 2023-02-16 06:01:42,338 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:42,339 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:42,339 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:42,340 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2e4cfd5995c64d0c930cf367cbed990e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,340 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,340 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 039b87697f744de69854ade660c3b86b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,342 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e2b950d5cb8c4d5582e5e5003eb17238 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,342 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,342 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b6009167a29f47e78b9c49ee494de0c0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,346 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,346 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 441f16a2391c454380d30333fb4a2391 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,346 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2508fc9adc94f16a4f25e590657f9e5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,346 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9bda6ec013b4613982f0a0d0c1eed88 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:42,352 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dfbe9265df6742adb7a720ec96719456 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4d5ef427dbe8835395a8e54e1a52c91c, disabling compactions & flushes 2023-02-16 06:01:42,352 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:42,352 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbd7b1671f82431e9ac502f70ae7a098 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. after waiting 0 ms 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:42,352 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:42,352 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3a52269a5f08aea7e535029b1f2c0642, disabling compactions & flushes 2023-02-16 06:01:42,353 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing a1e7630ab1b0edfa00cd1a51f560840c, disabling compactions & flushes 2023-02-16 06:01:42,353 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ab800399a33449d1abacba4baeb7c351 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. after waiting 0 ms 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing b75faf2c1d6968e78e6d32f5d886762f, disabling compactions & flushes 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:42,353 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:42,353 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:42,353 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. after waiting 0 ms 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. after waiting 0 ms 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:42,353 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:42,353 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:42,354 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:42,354 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:42,354 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 66405203c3668dfd93dda67bb3aee13a, disabling compactions & flushes 2023-02-16 06:01:42,356 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. after waiting 0 ms 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:42,356 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:42,356 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0825a23a72fc4a139a19e5d951cb27f6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5f6f56372f62ae23503f9035d0f5207e, disabling compactions & flushes 2023-02-16 06:01:42,356 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. after waiting 0 ms 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:42,356 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:42,356 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:42,358 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d19c8b1cd01ba9b6f5d03b847e096f74, disabling compactions & flushes 2023-02-16 06:01:42,358 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:42,358 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:42,358 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. after waiting 0 ms 2023-02-16 06:01:42,358 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:42,358 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:42,359 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:42,359 INFO [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676527298838 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:42,359 DEBUG [Listener at localhost/45879] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,359 DEBUG [Listener at localhost/45879] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0 2023-02-16 06:01:42,360 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-data/ 2023-02-16 06:01:42,360 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----default/ 2023-02-16 06:01:42,360 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 06:01:42,361 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------117fbd5126f592bcfc584d2acebefd49/ 2023-02-16 06:01:42,361 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,361 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------3a52269a5f08aea7e535029b1f2c0642/ 2023-02-16 06:01:42,362 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,362 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,362 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=3a52269a5f08aea7e535029b1f2c0642-e4f9fc57ebdd4af59331b5cd9e8c3965 2023-02-16 06:01:42,362 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,363 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=3a52269a5f08aea7e535029b1f2c0642-e2b950d5cb8c4d5582e5e5003eb17238 2023-02-16 06:01:42,363 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------4d5ef427dbe8835395a8e54e1a52c91c/ 2023-02-16 06:01:42,363 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,363 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,364 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=4d5ef427dbe8835395a8e54e1a52c91c-af9dc81e4c7c42a091682126125cd9b7 2023-02-16 06:01:42,364 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,364 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=4d5ef427dbe8835395a8e54e1a52c91c-2e4cfd5995c64d0c930cf367cbed990e 2023-02-16 06:01:42,364 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------4fdd91f4e78271f962e0bbf89e0e537f/ 2023-02-16 06:01:42,365 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,365 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,365 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=4fdd91f4e78271f962e0bbf89e0e537f-a59328eba4e64526a82962ed0fcdc314 2023-02-16 06:01:42,365 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,366 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=4fdd91f4e78271f962e0bbf89e0e537f-2947c1e3cc0c40ee9cce7dbadb2cdac3 2023-02-16 06:01:42,366 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------5f6f56372f62ae23503f9035d0f5207e/ 2023-02-16 06:01:42,366 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,366 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,367 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=5f6f56372f62ae23503f9035d0f5207e-b6009167a29f47e78b9c49ee494de0c0 2023-02-16 06:01:42,367 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,367 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=5f6f56372f62ae23503f9035d0f5207e-ab800399a33449d1abacba4baeb7c351 2023-02-16 06:01:42,367 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------66405203c3668dfd93dda67bb3aee13a/ 2023-02-16 06:01:42,368 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,368 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,368 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=66405203c3668dfd93dda67bb3aee13a-f9bda6ec013b4613982f0a0d0c1eed88 2023-02-16 06:01:42,369 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,369 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=66405203c3668dfd93dda67bb3aee13a-bbd7b1671f82431e9ac502f70ae7a098 2023-02-16 06:01:42,369 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------a0011662b3ea8e0ef912d56a4c6bada8/ 2023-02-16 06:01:42,369 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,369 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------a1e7630ab1b0edfa00cd1a51f560840c/ 2023-02-16 06:01:42,370 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,370 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,370 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=a1e7630ab1b0edfa00cd1a51f560840c-039b87697f744de69854ade660c3b86b 2023-02-16 06:01:42,371 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,371 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=a1e7630ab1b0edfa00cd1a51f560840c-d2508fc9adc94f16a4f25e590657f9e5 2023-02-16 06:01:42,371 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------b75faf2c1d6968e78e6d32f5d886762f/ 2023-02-16 06:01:42,372 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,372 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,372 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=b75faf2c1d6968e78e6d32f5d886762f-c0c3c906a73846aba32ba397cbf39d10 2023-02-16 06:01:42,372 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,373 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=b75faf2c1d6968e78e6d32f5d886762f-441f16a2391c454380d30333fb4a2391 2023-02-16 06:01:42,373 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |----------d19c8b1cd01ba9b6f5d03b847e096f74/ 2023-02-16 06:01:42,373 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:42,373 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:42,374 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=d19c8b1cd01ba9b6f5d03b847e096f74-dfbe9265df6742adb7a720ec96719456 2023-02-16 06:01:42,374 DEBUG [Listener at localhost/45879] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:42,374 DEBUG [Listener at localhost/45879] util.CommonFSUtils(702): |----------------testWithMapReduce=d19c8b1cd01ba9b6f5d03b847e096f74-0825a23a72fc4a139a19e5d951cb27f6 2023-02-16 06:01:42,375 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:42,375 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:42,375 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:42,376 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,300 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop-5091383450413254829.jar 2023-02-16 06:01:43,300 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,300 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,366 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop-6053906882286192687.jar 2023-02-16 06:01:43,367 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,367 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,367 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,368 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,368 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,369 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,369 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 06:01:43,369 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 06:01:43,370 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 06:01:43,370 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 06:01:43,370 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 06:01:43,371 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 06:01:43,371 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 06:01:43,371 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 06:01:43,372 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 06:01:43,372 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 06:01:43,373 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 06:01:43,373 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:01:43,374 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:01:43,374 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:01:43,374 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 06:01:43,441 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop-5178035593761211156.jar 2023-02-16 06:01:43,441 DEBUG [Listener at localhost/45879] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 06:01:43,447 WARN [Listener at localhost/45879] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 06:01:43,453 WARN [Listener at localhost/45879] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 06:01:43,460 INFO [Listener at localhost/45879] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 06:01:43,562 WARN [Listener at localhost/45879] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/mapreduce.cluster.local.dir/1676527303528/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 06:01:43,562 WARN [Listener at localhost/45879] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/mapreduce.cluster.local.dir/1676527303528/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 06:01:43,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,609 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,609 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,611 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:43,612 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1 2023-02-16 06:01:43,613 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f6f56372f62ae23503f9035d0f5207e columnFamilyName f1 2023-02-16 06:01:43,618 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f1/testWithMapReduce=5f6f56372f62ae23503f9035d0f5207e-b6009167a29f47e78b9c49ee494de0c0 2023-02-16 06:01:43,618 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(310): Store=5f6f56372f62ae23503f9035d0f5207e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,618 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f6f56372f62ae23503f9035d0f5207e 2023-02-16 06:01:43,619 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2 2023-02-16 06:01:43,620 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f6f56372f62ae23503f9035d0f5207e columnFamilyName f2 2023-02-16 06:01:43,625 DEBUG [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/5f6f56372f62ae23503f9035d0f5207e/f2/testWithMapReduce=5f6f56372f62ae23503f9035d0f5207e-ab800399a33449d1abacba4baeb7c351 2023-02-16 06:01:43,625 INFO [StoreOpener-5f6f56372f62ae23503f9035d0f5207e-1] regionserver.HStore(310): Store=5f6f56372f62ae23503f9035d0f5207e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,625 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,625 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5f6f56372f62ae23503f9035d0f5207e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66591250, jitterRate=-0.007713049650192261}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,625 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:43,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5f6f56372f62ae23503f9035d0f5207e, disabling compactions & flushes 2023-02-16 06:01:43,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:43,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:43,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. after waiting 0 ms 2023-02-16 06:01:43,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:43,667 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676527298043.5f6f56372f62ae23503f9035d0f5207e. 2023-02-16 06:01:43,667 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5f6f56372f62ae23503f9035d0f5207e: 2023-02-16 06:01:43,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,670 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,672 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,673 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:43,675 DEBUG [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/f1 2023-02-16 06:01:43,675 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 117fbd5126f592bcfc584d2acebefd49 columnFamilyName f1 2023-02-16 06:01:43,676 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(310): Store=117fbd5126f592bcfc584d2acebefd49/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,676 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 117fbd5126f592bcfc584d2acebefd49 2023-02-16 06:01:43,677 DEBUG [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/117fbd5126f592bcfc584d2acebefd49/f2 2023-02-16 06:01:43,677 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 117fbd5126f592bcfc584d2acebefd49 columnFamilyName f2 2023-02-16 06:01:43,677 INFO [StoreOpener-117fbd5126f592bcfc584d2acebefd49-1] regionserver.HStore(310): Store=117fbd5126f592bcfc584d2acebefd49/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,678 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 117fbd5126f592bcfc584d2acebefd49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71011832, jitterRate=0.0581587553024292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:43,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 117fbd5126f592bcfc584d2acebefd49, disabling compactions & flushes 2023-02-16 06:01:43,696 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:43,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:43,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. after waiting 0 ms 2023-02-16 06:01:43,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:43,696 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527298043.117fbd5126f592bcfc584d2acebefd49. 2023-02-16 06:01:43,696 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 117fbd5126f592bcfc584d2acebefd49: 2023-02-16 06:01:43,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,700 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,701 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,703 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:43,704 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1 2023-02-16 06:01:43,705 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66405203c3668dfd93dda67bb3aee13a columnFamilyName f1 2023-02-16 06:01:43,710 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f1/testWithMapReduce=66405203c3668dfd93dda67bb3aee13a-f9bda6ec013b4613982f0a0d0c1eed88 2023-02-16 06:01:43,710 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(310): Store=66405203c3668dfd93dda67bb3aee13a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,710 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 66405203c3668dfd93dda67bb3aee13a 2023-02-16 06:01:43,711 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2 2023-02-16 06:01:43,712 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66405203c3668dfd93dda67bb3aee13a columnFamilyName f2 2023-02-16 06:01:43,717 DEBUG [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/66405203c3668dfd93dda67bb3aee13a/f2/testWithMapReduce=66405203c3668dfd93dda67bb3aee13a-bbd7b1671f82431e9ac502f70ae7a098 2023-02-16 06:01:43,717 INFO [StoreOpener-66405203c3668dfd93dda67bb3aee13a-1] regionserver.HStore(310): Store=66405203c3668dfd93dda67bb3aee13a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,717 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,717 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 66405203c3668dfd93dda67bb3aee13a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74188506, jitterRate=0.10549488663673401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,717 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:43,750 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 66405203c3668dfd93dda67bb3aee13a, disabling compactions & flushes 2023-02-16 06:01:43,750 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:43,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:43,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. after waiting 0 ms 2023-02-16 06:01:43,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:43,751 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676527298043.66405203c3668dfd93dda67bb3aee13a. 2023-02-16 06:01:43,752 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 66405203c3668dfd93dda67bb3aee13a: 2023-02-16 06:01:43,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,755 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,756 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,758 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:43,759 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1 2023-02-16 06:01:43,759 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5ef427dbe8835395a8e54e1a52c91c columnFamilyName f1 2023-02-16 06:01:43,764 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f1/testWithMapReduce=4d5ef427dbe8835395a8e54e1a52c91c-af9dc81e4c7c42a091682126125cd9b7 2023-02-16 06:01:43,764 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(310): Store=4d5ef427dbe8835395a8e54e1a52c91c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,764 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d5ef427dbe8835395a8e54e1a52c91c 2023-02-16 06:01:43,765 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2 2023-02-16 06:01:43,765 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5ef427dbe8835395a8e54e1a52c91c columnFamilyName f2 2023-02-16 06:01:43,770 DEBUG [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4d5ef427dbe8835395a8e54e1a52c91c/f2/testWithMapReduce=4d5ef427dbe8835395a8e54e1a52c91c-2e4cfd5995c64d0c930cf367cbed990e 2023-02-16 06:01:43,771 INFO [StoreOpener-4d5ef427dbe8835395a8e54e1a52c91c-1] regionserver.HStore(310): Store=4d5ef427dbe8835395a8e54e1a52c91c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,771 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,771 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4d5ef427dbe8835395a8e54e1a52c91c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72987422, jitterRate=0.08759734034538269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,771 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:43,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4d5ef427dbe8835395a8e54e1a52c91c, disabling compactions & flushes 2023-02-16 06:01:43,811 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:43,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:43,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. after waiting 0 ms 2023-02-16 06:01:43,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:43,813 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676527298043.4d5ef427dbe8835395a8e54e1a52c91c. 2023-02-16 06:01:43,813 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4d5ef427dbe8835395a8e54e1a52c91c: 2023-02-16 06:01:43,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,817 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,824 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,826 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:43,828 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1 2023-02-16 06:01:43,828 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdd91f4e78271f962e0bbf89e0e537f columnFamilyName f1 2023-02-16 06:01:43,834 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f1/testWithMapReduce=4fdd91f4e78271f962e0bbf89e0e537f-a59328eba4e64526a82962ed0fcdc314 2023-02-16 06:01:43,834 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(310): Store=4fdd91f4e78271f962e0bbf89e0e537f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,834 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fdd91f4e78271f962e0bbf89e0e537f 2023-02-16 06:01:43,835 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2 2023-02-16 06:01:43,835 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdd91f4e78271f962e0bbf89e0e537f columnFamilyName f2 2023-02-16 06:01:43,840 DEBUG [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/4fdd91f4e78271f962e0bbf89e0e537f/f2/testWithMapReduce=4fdd91f4e78271f962e0bbf89e0e537f-2947c1e3cc0c40ee9cce7dbadb2cdac3 2023-02-16 06:01:43,840 INFO [StoreOpener-4fdd91f4e78271f962e0bbf89e0e537f-1] regionserver.HStore(310): Store=4fdd91f4e78271f962e0bbf89e0e537f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,840 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,840 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4fdd91f4e78271f962e0bbf89e0e537f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62520722, jitterRate=-0.06836864352226257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,840 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:43,867 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4fdd91f4e78271f962e0bbf89e0e537f, disabling compactions & flushes 2023-02-16 06:01:43,868 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:43,868 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:43,868 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. after waiting 0 ms 2023-02-16 06:01:43,868 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:43,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676527298043.4fdd91f4e78271f962e0bbf89e0e537f. 2023-02-16 06:01:43,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4fdd91f4e78271f962e0bbf89e0e537f: 2023-02-16 06:01:43,872 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,872 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,874 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,875 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:43,876 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1 2023-02-16 06:01:43,877 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19c8b1cd01ba9b6f5d03b847e096f74 columnFamilyName f1 2023-02-16 06:01:43,882 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f1/testWithMapReduce=d19c8b1cd01ba9b6f5d03b847e096f74-dfbe9265df6742adb7a720ec96719456 2023-02-16 06:01:43,882 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(310): Store=d19c8b1cd01ba9b6f5d03b847e096f74/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,882 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d19c8b1cd01ba9b6f5d03b847e096f74 2023-02-16 06:01:43,883 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2 2023-02-16 06:01:43,884 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19c8b1cd01ba9b6f5d03b847e096f74 columnFamilyName f2 2023-02-16 06:01:43,889 DEBUG [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/d19c8b1cd01ba9b6f5d03b847e096f74/f2/testWithMapReduce=d19c8b1cd01ba9b6f5d03b847e096f74-0825a23a72fc4a139a19e5d951cb27f6 2023-02-16 06:01:43,889 INFO [StoreOpener-d19c8b1cd01ba9b6f5d03b847e096f74-1] regionserver.HStore(310): Store=d19c8b1cd01ba9b6f5d03b847e096f74/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,889 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d19c8b1cd01ba9b6f5d03b847e096f74; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72131955, jitterRate=0.07484988868236542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:43,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d19c8b1cd01ba9b6f5d03b847e096f74, disabling compactions & flushes 2023-02-16 06:01:43,921 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:43,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:43,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. after waiting 0 ms 2023-02-16 06:01:43,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:43,922 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676527298043.d19c8b1cd01ba9b6f5d03b847e096f74. 2023-02-16 06:01:43,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d19c8b1cd01ba9b6f5d03b847e096f74: 2023-02-16 06:01:43,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,924 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,926 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,927 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:43,928 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1 2023-02-16 06:01:43,929 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1e7630ab1b0edfa00cd1a51f560840c columnFamilyName f1 2023-02-16 06:01:43,936 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f1/testWithMapReduce=a1e7630ab1b0edfa00cd1a51f560840c-039b87697f744de69854ade660c3b86b 2023-02-16 06:01:43,936 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(310): Store=a1e7630ab1b0edfa00cd1a51f560840c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,936 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1e7630ab1b0edfa00cd1a51f560840c 2023-02-16 06:01:43,937 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2 2023-02-16 06:01:43,937 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1e7630ab1b0edfa00cd1a51f560840c columnFamilyName f2 2023-02-16 06:01:43,942 DEBUG [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/a1e7630ab1b0edfa00cd1a51f560840c/f2/testWithMapReduce=a1e7630ab1b0edfa00cd1a51f560840c-d2508fc9adc94f16a4f25e590657f9e5 2023-02-16 06:01:43,942 INFO [StoreOpener-a1e7630ab1b0edfa00cd1a51f560840c-1] regionserver.HStore(310): Store=a1e7630ab1b0edfa00cd1a51f560840c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,943 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,943 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a1e7630ab1b0edfa00cd1a51f560840c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70203643, jitterRate=0.046115800738334656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,943 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:43,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a1e7630ab1b0edfa00cd1a51f560840c, disabling compactions & flushes 2023-02-16 06:01:43,970 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:43,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:43,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. after waiting 0 ms 2023-02-16 06:01:43,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:43,971 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676527298043.a1e7630ab1b0edfa00cd1a51f560840c. 2023-02-16 06:01:43,971 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a1e7630ab1b0edfa00cd1a51f560840c: 2023-02-16 06:01:43,974 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:43,975 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:43,976 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:43,978 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:43,979 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1 2023-02-16 06:01:43,979 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a52269a5f08aea7e535029b1f2c0642 columnFamilyName f1 2023-02-16 06:01:43,988 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f1/testWithMapReduce=3a52269a5f08aea7e535029b1f2c0642-e4f9fc57ebdd4af59331b5cd9e8c3965 2023-02-16 06:01:43,989 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(310): Store=3a52269a5f08aea7e535029b1f2c0642/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,989 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a52269a5f08aea7e535029b1f2c0642 2023-02-16 06:01:43,990 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2 2023-02-16 06:01:43,990 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a52269a5f08aea7e535029b1f2c0642 columnFamilyName f2 2023-02-16 06:01:43,994 DEBUG [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/3a52269a5f08aea7e535029b1f2c0642/f2/testWithMapReduce=3a52269a5f08aea7e535029b1f2c0642-e2b950d5cb8c4d5582e5e5003eb17238 2023-02-16 06:01:43,994 INFO [StoreOpener-3a52269a5f08aea7e535029b1f2c0642-1] regionserver.HStore(310): Store=3a52269a5f08aea7e535029b1f2c0642/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:43,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:43,995 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3a52269a5f08aea7e535029b1f2c0642; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61223456, jitterRate=-0.08769941329956055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:43,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:44,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3a52269a5f08aea7e535029b1f2c0642, disabling compactions & flushes 2023-02-16 06:01:44,030 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:44,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:44,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. after waiting 0 ms 2023-02-16 06:01:44,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:44,031 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676527298043.3a52269a5f08aea7e535029b1f2c0642. 2023-02-16 06:01:44,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3a52269a5f08aea7e535029b1f2c0642: 2023-02-16 06:01:44,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:44,034 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:44,035 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:44,036 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:44,037 DEBUG [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/f1 2023-02-16 06:01:44,038 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0011662b3ea8e0ef912d56a4c6bada8 columnFamilyName f1 2023-02-16 06:01:44,039 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(310): Store=a0011662b3ea8e0ef912d56a4c6bada8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:44,039 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a0011662b3ea8e0ef912d56a4c6bada8 2023-02-16 06:01:44,040 DEBUG [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/a0011662b3ea8e0ef912d56a4c6bada8/f2 2023-02-16 06:01:44,040 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0011662b3ea8e0ef912d56a4c6bada8 columnFamilyName f2 2023-02-16 06:01:44,041 INFO [StoreOpener-a0011662b3ea8e0ef912d56a4c6bada8-1] regionserver.HStore(310): Store=a0011662b3ea8e0ef912d56a4c6bada8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:44,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:44,041 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a0011662b3ea8e0ef912d56a4c6bada8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74628967, jitterRate=0.11205826699733734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:44,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:44,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a0011662b3ea8e0ef912d56a4c6bada8, disabling compactions & flushes 2023-02-16 06:01:44,061 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:44,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:44,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. after waiting 0 ms 2023-02-16 06:01:44,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:44,062 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676527298043.a0011662b3ea8e0ef912d56a4c6bada8. 2023-02-16 06:01:44,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a0011662b3ea8e0ef912d56a4c6bada8: 2023-02-16 06:01:44,065 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:44,065 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:44,066 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:44,068 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:44,069 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1 2023-02-16 06:01:44,069 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b75faf2c1d6968e78e6d32f5d886762f columnFamilyName f1 2023-02-16 06:01:44,074 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f1/testWithMapReduce=b75faf2c1d6968e78e6d32f5d886762f-c0c3c906a73846aba32ba397cbf39d10 2023-02-16 06:01:44,074 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(310): Store=b75faf2c1d6968e78e6d32f5d886762f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:44,074 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b75faf2c1d6968e78e6d32f5d886762f 2023-02-16 06:01:44,074 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2 2023-02-16 06:01:44,075 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b75faf2c1d6968e78e6d32f5d886762f columnFamilyName f2 2023-02-16 06:01:44,079 DEBUG [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(539): loaded hdfs://localhost:38621/user/jenkins/test-data/f42b1d87-3172-1607-f1d2-9f96959a261a/testWithMapReduceAndOfflineHBaseMultiRegion/b859f2a0-7ed6-4774-a0bc-0fca53ccc4d0/data/default/testWithMapReduce/b75faf2c1d6968e78e6d32f5d886762f/f2/testWithMapReduce=b75faf2c1d6968e78e6d32f5d886762f-441f16a2391c454380d30333fb4a2391 2023-02-16 06:01:44,079 INFO [StoreOpener-b75faf2c1d6968e78e6d32f5d886762f-1] regionserver.HStore(310): Store=b75faf2c1d6968e78e6d32f5d886762f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:44,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:44,080 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b75faf2c1d6968e78e6d32f5d886762f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59579632, jitterRate=-0.11219429969787598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:44,080 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:44,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b75faf2c1d6968e78e6d32f5d886762f, disabling compactions & flushes 2023-02-16 06:01:44,108 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:44,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:44,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. after waiting 0 ms 2023-02-16 06:01:44,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:44,109 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676527298043.b75faf2c1d6968e78e6d32f5d886762f. 2023-02-16 06:01:44,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b75faf2c1d6968e78e6d32f5d886762f: 2023-02-16 06:01:44,609 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:01:44,610 WARN [Listener at localhost/45879] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:44,613 INFO [Listener at localhost/45879] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:44,716 WARN [BP-1149802304-172.31.14.131-1676527295848 heartbeating to localhost/127.0.0.1:38621] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:44,716 WARN [BP-1149802304-172.31.14.131-1676527295848 heartbeating to localhost/127.0.0.1:38621] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1149802304-172.31.14.131-1676527295848 (Datanode Uuid 0565f921-12f2-4092-86b7-340457e44cb6) service to localhost/127.0.0.1:38621 2023-02-16 06:01:44,717 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/dfs/data/data3/current/BP-1149802304-172.31.14.131-1676527295848] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:44,717 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/dfs/data/data4/current/BP-1149802304-172.31.14.131-1676527295848] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:44,718 WARN [Listener at localhost/45879] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:44,721 INFO [Listener at localhost/45879] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:44,826 WARN [BP-1149802304-172.31.14.131-1676527295848 heartbeating to localhost/127.0.0.1:38621] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:44,827 WARN [BP-1149802304-172.31.14.131-1676527295848 heartbeating to localhost/127.0.0.1:38621] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1149802304-172.31.14.131-1676527295848 (Datanode Uuid 92bd52d2-b076-4d3e-ab46-b1196089c88f) service to localhost/127.0.0.1:38621 2023-02-16 06:01:44,828 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/dfs/data/data1/current/BP-1149802304-172.31.14.131-1676527295848] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:44,828 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/cluster_197fd4ea-92dd-0cf2-f88d-97c9bee2f348/dfs/data/data2/current/BP-1149802304-172.31.14.131-1676527295848] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:44,838 INFO [Listener at localhost/45879] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:44,958 INFO [Listener at localhost/45879] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:01:45,007 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:01:45,021 INFO [Listener at localhost/45879] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 104) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38621 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:38621 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:38621 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:38621 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36811,1676527296576)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:38621 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45879 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:38621 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:38621 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=545 (was 554), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 322), ProcessCount=168 (was 168), AvailableMemoryMB=2018 (was 2530) 2023-02-16 06:01:45,031 INFO [Listener at localhost/45879] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=545, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=168, AvailableMemoryMB=2018 2023-02-16 06:01:45,042 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop.log.dir so I do NOT create it in target/test-data/56ea45e9-501e-113f-96e5-78f606145e30 2023-02-16 06:01:45,042 WARN [Listener at localhost/45879] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 06:01:45,042 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop.tmp.dir so I do NOT create it in target/test-data/56ea45e9-501e-113f-96e5-78f606145e30 2023-02-16 06:01:45,042 WARN [Listener at localhost/45879] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e5233e4d-687a-c217-59e4-208ef2f1a003/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 06:01:45,042 DEBUG [Listener at localhost/45879] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30 2023-02-16 06:01:45,042 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:01:45,042 INFO [Listener at localhost/45879] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733, deleteOnExit=true 2023-02-16 06:01:45,042 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:01:45,042 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/test.cache.data in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:01:45,043 DEBUG [Listener at localhost/45879] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:45,043 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:01:45,044 INFO [Listener at localhost/45879] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:01:45,048 WARN [Listener at localhost/45879] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:45,049 WARN [Listener at localhost/45879] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:45,104 WARN [Listener at localhost/45879] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:45,107 INFO [Listener at localhost/45879] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:45,119 INFO [Listener at localhost/45879] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/java.io.tmpdir/Jetty_localhost_38433_hdfs____.9r2uyv/webapp 2023-02-16 06:01:45,211 INFO [Listener at localhost/45879] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38433 2023-02-16 06:01:45,215 WARN [Listener at localhost/45879] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:45,215 WARN [Listener at localhost/45879] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:45,257 WARN [Listener at localhost/33547] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:45,277 WARN [Listener at localhost/33547] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:45,280 WARN [Listener at localhost/33547] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:45,281 INFO [Listener at localhost/33547] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:45,288 INFO [Listener at localhost/33547] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/java.io.tmpdir/Jetty_localhost_42803_datanode____.vxtn6k/webapp 2023-02-16 06:01:45,399 INFO [Listener at localhost/33547] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42803 2023-02-16 06:01:45,407 WARN [Listener at localhost/36465] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:45,437 WARN [Listener at localhost/36465] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:45,448 WARN [Listener at localhost/36465] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:45,449 INFO [Listener at localhost/36465] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:45,456 INFO [Listener at localhost/36465] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/java.io.tmpdir/Jetty_localhost_39937_datanode____92skgu/webapp 2023-02-16 06:01:45,540 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x886c5adf57606a5e: Processing first storage report for DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f from datanode 92c70ff3-438c-4995-aa41-2d0de902403e 2023-02-16 06:01:45,540 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x886c5adf57606a5e: from storage DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f node DatanodeRegistration(127.0.0.1:36019, datanodeUuid=92c70ff3-438c-4995-aa41-2d0de902403e, infoPort=45527, infoSecurePort=0, ipcPort=36465, storageInfo=lv=-57;cid=testClusterID;nsid=645083262;c=1676527305051), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:45,540 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x886c5adf57606a5e: Processing first storage report for DS-97048651-bfd9-46f2-a7ce-1ebdbfde73f5 from datanode 92c70ff3-438c-4995-aa41-2d0de902403e 2023-02-16 06:01:45,540 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x886c5adf57606a5e: from storage DS-97048651-bfd9-46f2-a7ce-1ebdbfde73f5 node DatanodeRegistration(127.0.0.1:36019, datanodeUuid=92c70ff3-438c-4995-aa41-2d0de902403e, infoPort=45527, infoSecurePort=0, ipcPort=36465, storageInfo=lv=-57;cid=testClusterID;nsid=645083262;c=1676527305051), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:45,581 INFO [Listener at localhost/36465] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39937 2023-02-16 06:01:45,589 WARN [Listener at localhost/33863] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:45,692 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1707a24f8f0cb7d: Processing first storage report for DS-9fce7b36-c01d-4c29-9542-09b8b94e03af from datanode 5329ed0d-26b9-480e-b162-0c4eabd19319 2023-02-16 06:01:45,692 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1707a24f8f0cb7d: from storage DS-9fce7b36-c01d-4c29-9542-09b8b94e03af node DatanodeRegistration(127.0.0.1:32957, datanodeUuid=5329ed0d-26b9-480e-b162-0c4eabd19319, infoPort=40975, infoSecurePort=0, ipcPort=33863, storageInfo=lv=-57;cid=testClusterID;nsid=645083262;c=1676527305051), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:45,692 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1707a24f8f0cb7d: Processing first storage report for DS-e1b2e790-89e6-4dd2-aa9a-ac3f948670e2 from datanode 5329ed0d-26b9-480e-b162-0c4eabd19319 2023-02-16 06:01:45,692 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1707a24f8f0cb7d: from storage DS-e1b2e790-89e6-4dd2-aa9a-ac3f948670e2 node DatanodeRegistration(127.0.0.1:32957, datanodeUuid=5329ed0d-26b9-480e-b162-0c4eabd19319, infoPort=40975, infoSecurePort=0, ipcPort=33863, storageInfo=lv=-57;cid=testClusterID;nsid=645083262;c=1676527305051), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:45,697 DEBUG [Listener at localhost/33863] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30 2023-02-16 06:01:45,699 INFO [Listener at localhost/33863] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/zookeeper_0, clientPort=56550, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:01:45,700 INFO [Listener at localhost/33863] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56550 2023-02-16 06:01:45,700 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,701 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,713 INFO [Listener at localhost/33863] util.FSUtils(479): Created version file at hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db with version=8 2023-02-16 06:01:45,713 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,714 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,715 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33547/user/jenkins/test-data/cdfd4ec7-a942-3cfd-4680-3f43d2129f71/hbase-staging 2023-02-16 06:01:45,716 INFO [Listener at localhost/33863] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:45,717 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,717 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,717 INFO [Listener at localhost/33863] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:45,717 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,717 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:45,717 INFO [Listener at localhost/33863] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:45,718 INFO [Listener at localhost/33863] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33027 2023-02-16 06:01:45,718 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,719 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,720 INFO [Listener at localhost/33863] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33027 connecting to ZooKeeper ensemble=127.0.0.1:56550 2023-02-16 06:01:45,727 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:330270x0, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:45,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33027-0x1005bb86da80000 connected 2023-02-16 06:01:45,740 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:45,740 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:45,741 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:45,741 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33027 2023-02-16 06:01:45,741 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33027 2023-02-16 06:01:45,741 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33027 2023-02-16 06:01:45,742 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33027 2023-02-16 06:01:45,742 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33027 2023-02-16 06:01:45,742 INFO [Listener at localhost/33863] master.HMaster(444): hbase.rootdir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db, hbase.cluster.distributed=false 2023-02-16 06:01:45,754 INFO [Listener at localhost/33863] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:45,754 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,754 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,754 INFO [Listener at localhost/33863] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:45,754 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,754 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:45,755 INFO [Listener at localhost/33863] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:45,757 INFO [Listener at localhost/33863] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36743 2023-02-16 06:01:45,758 INFO [Listener at localhost/33863] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:45,758 DEBUG [Listener at localhost/33863] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:45,759 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,760 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,761 INFO [Listener at localhost/33863] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36743 connecting to ZooKeeper ensemble=127.0.0.1:56550 2023-02-16 06:01:45,763 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:367430x0, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:45,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36743-0x1005bb86da80001 connected 2023-02-16 06:01:45,765 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:45,765 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:45,766 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:45,766 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36743 2023-02-16 06:01:45,766 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36743 2023-02-16 06:01:45,767 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36743 2023-02-16 06:01:45,767 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36743 2023-02-16 06:01:45,767 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36743 2023-02-16 06:01:45,778 INFO [Listener at localhost/33863] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:45,778 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,778 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,779 INFO [Listener at localhost/33863] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:45,779 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:45,779 INFO [Listener at localhost/33863] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:45,779 INFO [Listener at localhost/33863] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:45,780 INFO [Listener at localhost/33863] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46007 2023-02-16 06:01:45,780 INFO [Listener at localhost/33863] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:45,781 DEBUG [Listener at localhost/33863] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:45,782 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,782 INFO [Listener at localhost/33863] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,783 INFO [Listener at localhost/33863] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46007 connecting to ZooKeeper ensemble=127.0.0.1:56550 2023-02-16 06:01:45,787 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:460070x0, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:45,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46007-0x1005bb86da80002 connected 2023-02-16 06:01:45,789 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:45,789 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:45,790 DEBUG [Listener at localhost/33863] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:45,791 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46007 2023-02-16 06:01:45,791 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46007 2023-02-16 06:01:45,791 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46007 2023-02-16 06:01:45,791 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46007 2023-02-16 06:01:45,792 DEBUG [Listener at localhost/33863] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46007 2023-02-16 06:01:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,794 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:45,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,796 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:45,796 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:45,796 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:45,796 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:45,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:45,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:45,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33027,1676527305716 from backup master directory 2023-02-16 06:01:45,800 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,800 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:45,800 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:45,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/hbase.id with ID: cb893222-4bf8-41e9-8bec-bfa9bcabc2ee 2023-02-16 06:01:45,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:45,822 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:45,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x293eda00 to 127.0.0.1:56550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:45,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2847c7d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:45,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:45,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:01:45,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:45,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store-tmp 2023-02-16 06:01:45,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:45,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:45,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:45,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:45,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:45,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:45,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:45,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:45,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/WALs/jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33027%2C1676527305716, suffix=, logDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/WALs/jenkins-hbase4.apache.org,33027,1676527305716, archiveDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/oldWALs, maxLogs=10 2023-02-16 06:01:45,858 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK] 2023-02-16 06:01:45,859 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK] 2023-02-16 06:01:45,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/WALs/jenkins-hbase4.apache.org,33027,1676527305716/jenkins-hbase4.apache.org%2C33027%2C1676527305716.1676527305844 2023-02-16 06:01:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK], DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK]] 2023-02-16 06:01:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:45,864 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:45,865 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:01:45,865 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:01:45,866 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:45,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:45,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:45,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:45,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:45,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73820227, jitterRate=0.10000710189342499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:45,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:45,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:01:45,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:01:45,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:01:45,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:01:45,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 06:01:45,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 06:01:45,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:01:45,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:01:45,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:01:45,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:01:45,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:01:45,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:01:45,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:01:45,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:01:45,893 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:45,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:01:45,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:01:45,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:01:45,896 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:45,896 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:45,896 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:45,896 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:45,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33027,1676527305716, sessionid=0x1005bb86da80000, setting cluster-up flag (Was=false) 2023-02-16 06:01:45,901 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:45,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:01:45,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,910 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:45,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:01:45,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:45,914 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.hbase-snapshot/.tmp 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:45,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527335918 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:45,918 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:45,918 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:01:45,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:01:45,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:01:45,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:01:45,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:01:45,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:01:45,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527305919,5,FailOnTimeoutGroup] 2023-02-16 06:01:45,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527305919,5,FailOnTimeoutGroup] 2023-02-16 06:01:45,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:45,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:01:45,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:45,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:45,920 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:45,928 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:45,928 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:45,928 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db 2023-02-16 06:01:45,934 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:45,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:45,936 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/info 2023-02-16 06:01:45,936 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:45,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:45,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:45,938 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:45,938 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:45,938 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:45,939 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:45,939 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/table 2023-02-16 06:01:45,940 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:45,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:45,940 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740 2023-02-16 06:01:45,941 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740 2023-02-16 06:01:45,942 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:45,943 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:45,944 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:45,945 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72692523, jitterRate=0.08320300281047821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:45,945 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:45,945 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:45,945 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:45,945 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:45,945 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:45,945 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:45,945 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:45,945 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:45,946 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:45,946 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:01:45,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:01:45,947 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:01:45,949 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:01:45,994 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(952): ClusterId : cb893222-4bf8-41e9-8bec-bfa9bcabc2ee 2023-02-16 06:01:45,994 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(952): ClusterId : cb893222-4bf8-41e9-8bec-bfa9bcabc2ee 2023-02-16 06:01:45,994 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:45,994 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:45,997 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:45,997 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:45,997 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:45,997 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:45,999 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:46,000 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:46,000 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ReadOnlyZKClient(139): Connect 0x5c6e13f5 to 127.0.0.1:56550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:46,001 DEBUG [RS:0;jenkins-hbase4:36743] zookeeper.ReadOnlyZKClient(139): Connect 0x1cf323a6 to 127.0.0.1:56550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:46,007 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a9e608, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:46,007 DEBUG [RS:0;jenkins-hbase4:36743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1234ce48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:46,007 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56967885, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:46,007 DEBUG [RS:0;jenkins-hbase4:36743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@160b48d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:46,016 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36743 2023-02-16 06:01:46,016 INFO [RS:0;jenkins-hbase4:36743] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:46,016 INFO [RS:0;jenkins-hbase4:36743] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:46,016 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:46,017 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33027,1676527305716 with isa=jenkins-hbase4.apache.org/172.31.14.131:36743, startcode=1676527305754 2023-02-16 06:01:46,017 DEBUG [RS:0;jenkins-hbase4:36743] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:46,017 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46007 2023-02-16 06:01:46,017 INFO [RS:1;jenkins-hbase4:46007] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:46,018 INFO [RS:1;jenkins-hbase4:46007] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:46,018 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:46,018 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33027,1676527305716 with isa=jenkins-hbase4.apache.org/172.31.14.131:46007, startcode=1676527305778 2023-02-16 06:01:46,018 DEBUG [RS:1;jenkins-hbase4:46007] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:46,020 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38061, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,021 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58387, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:46,022 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db 2023-02-16 06:01:46,022 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33547 2023-02-16 06:01:46,022 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:46,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,022 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db 2023-02-16 06:01:46,022 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33547 2023-02-16 06:01:46,022 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:46,023 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:46,026 DEBUG [RS:0;jenkins-hbase4:36743] zookeeper.ZKUtil(162): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,027 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36743,1676527305754] 2023-02-16 06:01:46,027 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46007,1676527305778] 2023-02-16 06:01:46,027 WARN [RS:0;jenkins-hbase4:36743] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:46,027 INFO [RS:0;jenkins-hbase4:36743] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:46,027 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,027 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,027 WARN [RS:1;jenkins-hbase4:46007] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:46,027 INFO [RS:1;jenkins-hbase4:46007] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:46,027 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,031 DEBUG [RS:0;jenkins-hbase4:36743] zookeeper.ZKUtil(162): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,031 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,032 DEBUG [RS:0;jenkins-hbase4:36743] zookeeper.ZKUtil(162): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,032 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ZKUtil(162): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,033 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:46,033 DEBUG [RS:0;jenkins-hbase4:36743] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:46,033 INFO [RS:1;jenkins-hbase4:46007] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:46,033 INFO [RS:0;jenkins-hbase4:36743] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:46,034 INFO [RS:1;jenkins-hbase4:46007] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:46,036 INFO [RS:1;jenkins-hbase4:46007] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:46,036 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,037 INFO [RS:0;jenkins-hbase4:36743] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:46,037 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:46,037 INFO [RS:0;jenkins-hbase4:36743] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:46,038 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,038 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:46,038 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:46,039 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:1;jenkins-hbase4:46007] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,039 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:46,040 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,040 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,040 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,040 DEBUG [RS:0;jenkins-hbase4:36743] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:46,040 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,040 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,040 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,041 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,041 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,041 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,052 INFO [RS:1;jenkins-hbase4:46007] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:46,052 INFO [RS:0;jenkins-hbase4:36743] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:46,052 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46007,1676527305778-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,052 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36743,1676527305754-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,062 INFO [RS:1;jenkins-hbase4:46007] regionserver.Replication(203): jenkins-hbase4.apache.org,46007,1676527305778 started 2023-02-16 06:01:46,062 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46007,1676527305778, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46007, sessionid=0x1005bb86da80002 2023-02-16 06:01:46,062 INFO [RS:0;jenkins-hbase4:36743] regionserver.Replication(203): jenkins-hbase4.apache.org,36743,1676527305754 started 2023-02-16 06:01:46,062 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:46,062 DEBUG [RS:1;jenkins-hbase4:46007] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,062 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46007,1676527305778' 2023-02-16 06:01:46,062 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:46,062 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36743,1676527305754, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36743, sessionid=0x1005bb86da80001 2023-02-16 06:01:46,062 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:46,062 DEBUG [RS:0;jenkins-hbase4:36743] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,062 DEBUG [RS:0;jenkins-hbase4:36743] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36743,1676527305754' 2023-02-16 06:01:46,062 DEBUG [RS:0;jenkins-hbase4:36743] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46007,1676527305778' 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36743,1676527305754' 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:46,063 DEBUG [RS:0;jenkins-hbase4:36743] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:46,063 DEBUG [RS:1;jenkins-hbase4:46007] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:46,064 INFO [RS:1;jenkins-hbase4:46007] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:46,064 INFO [RS:1;jenkins-hbase4:46007] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:46,064 DEBUG [RS:0;jenkins-hbase4:36743] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:46,064 INFO [RS:0;jenkins-hbase4:36743] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:46,064 INFO [RS:0;jenkins-hbase4:36743] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:46,099 DEBUG [jenkins-hbase4:33027] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:01:46,099 DEBUG [jenkins-hbase4:33027] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:46,100 DEBUG [jenkins-hbase4:33027] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:46,100 DEBUG [jenkins-hbase4:33027] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:46,101 DEBUG [jenkins-hbase4:33027] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:46,101 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46007,1676527305778, state=OPENING 2023-02-16 06:01:46,103 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:01:46,104 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:46,104 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:46,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46007,1676527305778}] 2023-02-16 06:01:46,258 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,258 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:46,260 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:46,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:01:46,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:46,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46007%2C1676527305778.meta, suffix=.meta, logDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,46007,1676527305778, archiveDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/oldWALs, maxLogs=32 2023-02-16 06:01:46,282 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK] 2023-02-16 06:01:46,282 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK] 2023-02-16 06:01:46,284 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,46007,1676527305778/jenkins-hbase4.apache.org%2C46007%2C1676527305778.meta.1676527306266.meta 2023-02-16 06:01:46,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK], DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK]] 2023-02-16 06:01:46,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:46,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:01:46,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:01:46,285 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:01:46,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:01:46,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:46,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:01:46,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:01:46,286 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:46,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/info 2023-02-16 06:01:46,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/info 2023-02-16 06:01:46,287 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:46,288 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:46,288 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:46,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:46,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:46,289 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:46,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:46,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:46,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/table 2023-02-16 06:01:46,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/table 2023-02-16 06:01:46,291 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:46,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:46,292 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740 2023-02-16 06:01:46,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740 2023-02-16 06:01:46,295 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:46,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:46,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75488969, jitterRate=0.12487329542636871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:46,297 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:46,298 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527306258 2023-02-16 06:01:46,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:01:46,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:01:46,302 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46007,1676527305778, state=OPEN 2023-02-16 06:01:46,303 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:01:46,303 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:46,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:01:46,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46007,1676527305778 in 199 msec 2023-02-16 06:01:46,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:01:46,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-16 06:01:46,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-16 06:01:46,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527306308, completionTime=-1 2023-02-16 06:01:46,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:01:46,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:01:46,311 DEBUG [hconnection-0x7e29ebe7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:46,312 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37682, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:46,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:01:46,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527366313 2023-02-16 06:01:46,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527426313 2023-02-16 06:01:46,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33027,1676527305716-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33027,1676527305716-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33027,1676527305716-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33027, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:01:46,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:46,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:01:46,324 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:01:46,324 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:46,325 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:46,326 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,326 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9 empty. 2023-02-16 06:01:46,327 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,327 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:01:46,336 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:46,337 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 27b03e527f0f4a65b320688d7ecd7cb9, NAME => 'hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp 2023-02-16 06:01:46,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:46,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 27b03e527f0f4a65b320688d7ecd7cb9, disabling compactions & flushes 2023-02-16 06:01:46,343 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. after waiting 0 ms 2023-02-16 06:01:46,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,343 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,343 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 27b03e527f0f4a65b320688d7ecd7cb9: 2023-02-16 06:01:46,345 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:46,346 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527306346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527306346"}]},"ts":"1676527306346"} 2023-02-16 06:01:46,347 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:01:46,348 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:46,348 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527306348"}]},"ts":"1676527306348"} 2023-02-16 06:01:46,349 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:01:46,352 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:46,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:46,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:46,353 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:46,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=27b03e527f0f4a65b320688d7ecd7cb9, ASSIGN}] 2023-02-16 06:01:46,355 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=27b03e527f0f4a65b320688d7ecd7cb9, ASSIGN 2023-02-16 06:01:46,356 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=27b03e527f0f4a65b320688d7ecd7cb9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1676527305778; forceNewPlan=false, retain=false 2023-02-16 06:01:46,506 INFO [jenkins-hbase4:33027] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:01:46,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=27b03e527f0f4a65b320688d7ecd7cb9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527306507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527306507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527306507"}]},"ts":"1676527306507"} 2023-02-16 06:01:46,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 27b03e527f0f4a65b320688d7ecd7cb9, server=jenkins-hbase4.apache.org,46007,1676527305778}] 2023-02-16 06:01:46,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46007%2C1676527305778, suffix=, logDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,46007,1676527305778, archiveDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/oldWALs, maxLogs=32 2023-02-16 06:01:46,682 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK] 2023-02-16 06:01:46,683 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK] 2023-02-16 06:01:46,684 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,46007,1676527305778/jenkins-hbase4.apache.org%2C46007%2C1676527305778.1676527306667 2023-02-16 06:01:46,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK], DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK]] 2023-02-16 06:01:46,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 27b03e527f0f4a65b320688d7ecd7cb9, NAME => 'hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:46,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:46,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,686 INFO [StoreOpener-27b03e527f0f4a65b320688d7ecd7cb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,687 DEBUG [StoreOpener-27b03e527f0f4a65b320688d7ecd7cb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/info 2023-02-16 06:01:46,687 DEBUG [StoreOpener-27b03e527f0f4a65b320688d7ecd7cb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/info 2023-02-16 06:01:46,687 INFO [StoreOpener-27b03e527f0f4a65b320688d7ecd7cb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27b03e527f0f4a65b320688d7ecd7cb9 columnFamilyName info 2023-02-16 06:01:46,688 INFO [StoreOpener-27b03e527f0f4a65b320688d7ecd7cb9-1] regionserver.HStore(310): Store=27b03e527f0f4a65b320688d7ecd7cb9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:46,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:46,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:46,694 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 27b03e527f0f4a65b320688d7ecd7cb9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62193432, jitterRate=-0.07324564456939697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:46,694 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 27b03e527f0f4a65b320688d7ecd7cb9: 2023-02-16 06:01:46,694 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9., pid=6, masterSystemTime=1676527306661 2023-02-16 06:01:46,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,696 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:46,696 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=27b03e527f0f4a65b320688d7ecd7cb9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:46,697 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527306696"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527306696"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527306696"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527306696"}]},"ts":"1676527306696"} 2023-02-16 06:01:46,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:01:46,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 27b03e527f0f4a65b320688d7ecd7cb9, server=jenkins-hbase4.apache.org,46007,1676527305778 in 189 msec 2023-02-16 06:01:46,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:01:46,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=27b03e527f0f4a65b320688d7ecd7cb9, ASSIGN in 346 msec 2023-02-16 06:01:46,702 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:46,702 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527306702"}]},"ts":"1676527306702"} 2023-02-16 06:01:46,703 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:01:46,705 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:46,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-16 06:01:46,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:01:46,725 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:46,725 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:46,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:01:46,735 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:46,739 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-16 06:01:46,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:01:46,756 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:46,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 06:01:46,765 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:01:46,767 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:01:46,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.967sec 2023-02-16 06:01:46,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:01:46,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:01:46,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:01:46,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33027,1676527305716-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:01:46,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33027,1676527305716-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:01:46,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:01:46,794 DEBUG [Listener at localhost/33863] zookeeper.ReadOnlyZKClient(139): Connect 0x45a4388c to 127.0.0.1:56550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:46,799 DEBUG [Listener at localhost/33863] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33f290c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:46,801 DEBUG [hconnection-0x453cd02-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:46,802 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37690, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:46,804 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:46,804 DEBUG [Listener at localhost/33863] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:01:46,806 DEBUG [Listener at localhost/33863] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:01:46,808 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58642, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:01:46,808 INFO [Listener at localhost/33863] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:46,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:46,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:01:46,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:58642 deadline: 1676527366809, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:46,809 INFO [Listener at localhost/33863] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 06:01:46,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:46,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:46,814 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:46,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-16 06:01:46,815 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:46,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:46,817 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:46,818 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 empty. 2023-02-16 06:01:46,818 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:46,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 06:01:46,831 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:46,832 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae4bb67a788dc019286c4ea22f21bd59, NAME => 'testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp 2023-02-16 06:01:46,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:46,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing ae4bb67a788dc019286c4ea22f21bd59, disabling compactions & flushes 2023-02-16 06:01:46,842 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:46,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:46,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. after waiting 0 ms 2023-02-16 06:01:46,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:46,842 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:46,842 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for ae4bb67a788dc019286c4ea22f21bd59: 2023-02-16 06:01:46,844 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:46,845 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676527306845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527306845"}]},"ts":"1676527306845"} 2023-02-16 06:01:46,846 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:01:46,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:46,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527306847"}]},"ts":"1676527306847"} 2023-02-16 06:01:46,848 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-16 06:01:46,852 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:46,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:46,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:46,853 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:46,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, ASSIGN}] 2023-02-16 06:01:46,855 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, ASSIGN 2023-02-16 06:01:46,856 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46007,1676527305778; forceNewPlan=false, retain=false 2023-02-16 06:01:46,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:47,006 INFO [jenkins-hbase4:33027] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:01:47,007 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ae4bb67a788dc019286c4ea22f21bd59, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676527307007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527307007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527307007"}]},"ts":"1676527307007"} 2023-02-16 06:01:47,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ae4bb67a788dc019286c4ea22f21bd59, server=jenkins-hbase4.apache.org,46007,1676527305778}] 2023-02-16 06:01:47,065 INFO [RS:0;jenkins-hbase4:36743] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36743%2C1676527305754, suffix=, logDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,36743,1676527305754, archiveDir=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/oldWALs, maxLogs=32 2023-02-16 06:01:47,084 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK] 2023-02-16 06:01:47,084 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK] 2023-02-16 06:01:47,092 INFO [RS:0;jenkins-hbase4:36743] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/WALs/jenkins-hbase4.apache.org,36743,1676527305754/jenkins-hbase4.apache.org%2C36743%2C1676527305754.1676527307066 2023-02-16 06:01:47,092 DEBUG [RS:0;jenkins-hbase4:36743] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32957,DS-9fce7b36-c01d-4c29-9542-09b8b94e03af,DISK], DatanodeInfoWithStorage[127.0.0.1:36019,DS-4bfc3c9a-4dee-4916-b3a4-082050b6894f,DISK]] 2023-02-16 06:01:47,121 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:01:47,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:47,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ae4bb67a788dc019286c4ea22f21bd59, NAME => 'testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,169 INFO [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,172 DEBUG [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1 2023-02-16 06:01:47,172 DEBUG [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1 2023-02-16 06:01:47,172 INFO [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae4bb67a788dc019286c4ea22f21bd59 columnFamilyName f1 2023-02-16 06:01:47,173 INFO [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] regionserver.HStore(310): Store=ae4bb67a788dc019286c4ea22f21bd59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:47,173 INFO [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,174 DEBUG [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2 2023-02-16 06:01:47,174 DEBUG [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2 2023-02-16 06:01:47,175 INFO [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae4bb67a788dc019286c4ea22f21bd59 columnFamilyName f2 2023-02-16 06:01:47,175 INFO [StoreOpener-ae4bb67a788dc019286c4ea22f21bd59-1] regionserver.HStore(310): Store=ae4bb67a788dc019286c4ea22f21bd59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:47,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:47,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:47,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:47,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ae4bb67a788dc019286c4ea22f21bd59; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61021633, jitterRate=-0.09070681035518646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:47,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ae4bb67a788dc019286c4ea22f21bd59: 2023-02-16 06:01:47,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59., pid=12, masterSystemTime=1676527307163 2023-02-16 06:01:47,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:47,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:47,188 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ae4bb67a788dc019286c4ea22f21bd59, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676527307188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527307188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527307188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527307188"}]},"ts":"1676527307188"} 2023-02-16 06:01:47,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 06:01:47,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ae4bb67a788dc019286c4ea22f21bd59, server=jenkins-hbase4.apache.org,46007,1676527305778 in 181 msec 2023-02-16 06:01:47,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 06:01:47,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, ASSIGN in 339 msec 2023-02-16 06:01:47,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:47,195 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527307194"}]},"ts":"1676527307194"} 2023-02-16 06:01:47,196 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-16 06:01:47,200 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:47,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 389 msec 2023-02-16 06:01:47,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:47,424 INFO [Listener at localhost/33863] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-16 06:01:47,424 DEBUG [Listener at localhost/33863] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-16 06:01:47,424 INFO [Listener at localhost/33863] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:47,426 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-16 06:01:47,426 INFO [Listener at localhost/33863] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:47,427 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-16 06:01:47,427 INFO [Listener at localhost/33863] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:01:47,474 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46007] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:47,596 INFO [Listener at localhost/33863] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:01:47,596 INFO [Listener at localhost/33863] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:01:47,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 06:01:47,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527307597 (current time:1676527307597). 2023-02-16 06:01:47,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:01:47,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] zookeeper.ReadOnlyZKClient(139): Connect 0x60db0f3b to 127.0.0.1:56550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:47,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6735a798, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:47,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:47,620 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:47,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60db0f3b to 127.0.0.1:56550 2023-02-16 06:01:47,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:47,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:01:47,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 06:01:47,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 06:01:47,628 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 06:01:47,629 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676527907629 2023-02-16 06:01:47,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 06:01:47,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:47,642 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 06:01:47,642 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:47,642 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:01:47,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 06:01:47,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 16 msec 2023-02-16 06:01:47,644 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 06:01:47,644 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676527907644 2023-02-16 06:01:47,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 06:01:47,656 INFO [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 06:01:47,656 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:47,657 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 06:01:47,657 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 06:01:47,728 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 06:01:47,728 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 06:01:47,729 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:47,730 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,729 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:47,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:47,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:47,730 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,730 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 06:01:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 06:01:47,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 06:01:47,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 06:01:47,731 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 06:01:47,731 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:47,732 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 06:01:47,732 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:47,732 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 06:01:47,732 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 06:01:47,733 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1676527305778' joining acquired barrier for procedure (foo) in zk 2023-02-16 06:01:47,733 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 06:01:47,733 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 06:01:47,733 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36743,1676527305754' joining acquired barrier for procedure (foo) in zk 2023-02-16 06:01:47,734 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,734 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,734 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:01:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:47,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1676527305778' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 06:01:47,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@715d5465[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:47,737 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 06:01:47,737 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:47,739 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:47,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 06:01:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 06:01:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 06:01:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 06:01:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36743,1676527305754' in zk 2023-02-16 06:01:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 06:01:47,739 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:47,739 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:47,739 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. started... 2023-02-16 06:01:47,740 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ae4bb67a788dc019286c4ea22f21bd59 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 06:01:47,741 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 06:01:47,741 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:47,742 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 06:01:47,742 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:47,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 06:01:47,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:47,744 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:01:47,944 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:47,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 06:01:47,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:47,946 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 06:01:48,189 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f1/52b933e6e11e423297c5143d1fedfcb2 2023-02-16 06:01:48,217 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f2/3c152af8b3094671ab031ab54d062259 2023-02-16 06:01:48,228 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f1/52b933e6e11e423297c5143d1fedfcb2 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/52b933e6e11e423297c5143d1fedfcb2 2023-02-16 06:01:48,233 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/52b933e6e11e423297c5143d1fedfcb2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:01:48,234 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f2/3c152af8b3094671ab031ab54d062259 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/3c152af8b3094671ab031ab54d062259 2023-02-16 06:01:48,241 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/3c152af8b3094671ab031ab54d062259, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:01:48,242 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ae4bb67a788dc019286c4ea22f21bd59 in 502ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:48,242 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 06:01:48,242 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ae4bb67a788dc019286c4ea22f21bd59: 2023-02-16 06:01:48,242 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.' region-info for snapshot=foo 2023-02-16 06:01:48,242 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:48,242 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/52b933e6e11e423297c5143d1fedfcb2] hfiles 2023-02-16 06:01:48,242 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/52b933e6e11e423297c5143d1fedfcb2 for snapshot=foo 2023-02-16 06:01:48,243 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/3c152af8b3094671ab031ab54d062259] hfiles 2023-02-16 06:01:48,243 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/3c152af8b3094671ab031ab54d062259 for snapshot=foo 2023-02-16 06:01:48,247 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:48,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 06:01:48,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:48,248 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 06:01:48,250 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. completed. 2023-02-16 06:01:48,250 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 06:01:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 06:01:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 06:01:48,250 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46007,1676527305778' in zk 2023-02-16 06:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 06:01:48,252 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:48,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:48,252 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 06:01:48,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:48,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:48,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:01:48,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:48,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:01:48,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,46007,1676527305778': 2023-02-16 06:01:48,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1676527305778' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 06:01:48,257 INFO [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 06:01:48,257 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:48,257 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:48,257 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 06:01:48,257 INFO [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:01:48,259 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,259 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,259 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,259 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:48,259 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,260 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:48,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:48,260 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:48,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:01:48,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,263 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,263 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 06:01:48,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 06:01:48,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:48,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 06:01:48,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 06:01:48,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:48,270 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,270 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:48,272 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:01:48,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:48,272 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:48,272 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:01:48,272 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:01:48,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.hbase-snapshot/.tmp/foo 2023-02-16 06:01:48,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.hbase-snapshot/.tmp/foo to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.hbase-snapshot/foo 2023-02-16 06:01:48,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-16 06:01:48,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.hbase-snapshot/.tmp/foo 2023-02-16 06:01:48,311 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.hbase-snapshot/.tmp/foo 2023-02-16 06:01:48,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676527307640Consolidate snapshot: foo at 1676527308270 (+630 ms)Loading Region manifests for foo at 1676527308270Writing data manifest for foo at 1676527308275 (+5 ms)Verifying snapshot: foo at 1676527308283 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676527308311 (+28 ms) 2023-02-16 06:01:48,314 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 06:01:48,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 673 msec 2023-02-16 06:01:48,748 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 06:01:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:01:48,750 INFO [Listener at localhost/33863] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:01:48,754 INFO [Listener at localhost/33863] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:01:48,759 INFO [Listener at localhost/33863] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:01:48,794 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46007] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:48,909 INFO [Listener at localhost/33863] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:01:48,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:01:48,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,917 INFO [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-16 06:01:48,917 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:48,918 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-16 06:01:48,918 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-16 06:01:48,919 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,919 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,920 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:48,920 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:48,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:48,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:48,920 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,921 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:48,921 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:48,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,922 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,932 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 06:01:48,932 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:48,932 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 06:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 06:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 06:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36743,1676527305754' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 06:01:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 06:01:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 06:01:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:48,934 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:48,934 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. started... 2023-02-16 06:01:48,934 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ae4bb67a788dc019286c4ea22f21bd59 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 06:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,948 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:48,948 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:48,958 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f1/10d44fa6316442d7991476f7ee3c0800 2023-02-16 06:01:48,982 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f2/a42f22f1e1444b35aa905285859801bd 2023-02-16 06:01:48,987 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f1/10d44fa6316442d7991476f7ee3c0800 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/10d44fa6316442d7991476f7ee3c0800 2023-02-16 06:01:48,991 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/10d44fa6316442d7991476f7ee3c0800, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:01:48,992 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/.tmp/f2/a42f22f1e1444b35aa905285859801bd as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/a42f22f1e1444b35aa905285859801bd 2023-02-16 06:01:48,998 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/a42f22f1e1444b35aa905285859801bd, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:01:48,999 INFO [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ae4bb67a788dc019286c4ea22f21bd59 in 65ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:49,001 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ae4bb67a788dc019286c4ea22f21bd59: 2023-02-16 06:01:49,001 DEBUG [rs(jenkins-hbase4.apache.org,46007,1676527305778)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 06:01:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 06:01:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 06:01:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46007,1676527305778' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 06:01:49,002 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,002 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:49,004 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:49,004 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:49,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46007,1676527305778' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-16 06:01:49,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7562de96[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:49,007 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-16 06:01:49,007 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 06:01:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,008 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 06:01:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 06:01:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 06:01:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,36743,1676527305754' in zk 2023-02-16 06:01:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,46007,1676527305778' in zk 2023-02-16 06:01:49,009 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,009 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:49,011 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 06:01:49,011 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:49,011 DEBUG [member: 'jenkins-hbase4.apache.org,36743,1676527305754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 06:01:49,013 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 06:01:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,46007,1676527305778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 06:01:49,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:49,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:49,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,46007,1676527305778': 2023-02-16 06:01:49,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46007,1676527305778' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-16 06:01:49,018 INFO [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-16 06:01:49,018 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:49,019 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:49,019 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,019 INFO [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:01:49,023 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:49,023 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:49,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:49,024 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,024 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,026 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:49,026 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:49,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:49,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-16 06:01:49,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:01:49,029 DEBUG [(jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:49,029 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:49,030 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,030 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:49,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:49,030 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,030 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:49,030 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:01:49,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:49,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:49,131 DEBUG [Listener at localhost/33863] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:01:49,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:01:49,136 INFO [Listener at localhost/33863] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676527307597 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:49,136 DEBUG [Listener at localhost/33863] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33547/user/jenkins/test-data/cdfd4ec7-a942-3cfd-4680-3f43d2129f71/foo/46ad203c-bff7-4dd5-a260-09882fb43b29/data/default/testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,137 INFO [Listener at localhost/33863] snapshot.RestoreSnapshotHelper(239): region to add: ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:49,137 INFO [Listener at localhost/33863] snapshot.RestoreSnapshotHelper(585): clone region=ae4bb67a788dc019286c4ea22f21bd59 as ae4bb67a788dc019286c4ea22f21bd59 in snapshot foo 2023-02-16 06:01:49,138 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae4bb67a788dc019286c4ea22f21bd59, NAME => 'testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33547/user/jenkins/test-data/cdfd4ec7-a942-3cfd-4680-3f43d2129f71/foo/46ad203c-bff7-4dd5-a260-09882fb43b29 2023-02-16 06:01:49,144 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:49,144 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 52b933e6e11e423297c5143d1fedfcb2 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,146 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c152af8b3094671ab031ab54d062259 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,148 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ae4bb67a788dc019286c4ea22f21bd59, disabling compactions & flushes 2023-02-16 06:01:49,148 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,148 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,148 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. after waiting 0 ms 2023-02-16 06:01:49,148 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,148 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,148 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ae4bb67a788dc019286c4ea22f21bd59: 2023-02-16 06:01:49,148 INFO [Listener at localhost/33863] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676527307597 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:49,149 DEBUG [Listener at localhost/33863] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33547/user/jenkins/test-data/cdfd4ec7-a942-3cfd-4680-3f43d2129f71/foo/46ad203c-bff7-4dd5-a260-09882fb43b29 2023-02-16 06:01:49,149 DEBUG [Listener at localhost/33863] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33547/user/jenkins/test-data/cdfd4ec7-a942-3cfd-4680-3f43d2129f71/foo/46ad203c-bff7-4dd5-a260-09882fb43b29 2023-02-16 06:01:49,149 DEBUG [Listener at localhost/33863] util.CommonFSUtils(699): |-data/ 2023-02-16 06:01:49,150 DEBUG [Listener at localhost/33863] util.CommonFSUtils(699): |----default/ 2023-02-16 06:01:49,150 DEBUG [Listener at localhost/33863] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-16 06:01:49,150 DEBUG [Listener at localhost/33863] util.CommonFSUtils(699): |----------ae4bb67a788dc019286c4ea22f21bd59/ 2023-02-16 06:01:49,151 DEBUG [Listener at localhost/33863] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:49,151 DEBUG [Listener at localhost/33863] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:49,151 DEBUG [Listener at localhost/33863] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=ae4bb67a788dc019286c4ea22f21bd59-52b933e6e11e423297c5143d1fedfcb2 2023-02-16 06:01:49,151 DEBUG [Listener at localhost/33863] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:49,151 DEBUG [Listener at localhost/33863] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=ae4bb67a788dc019286c4ea22f21bd59-3c152af8b3094671ab031ab54d062259 2023-02-16 06:01:49,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 06:01:49,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 06:01:49,155 INFO [Listener at localhost/33863] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:01:49,159 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527309159"}]},"ts":"1676527309159"} 2023-02-16 06:01:49,160 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-16 06:01:49,163 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-16 06:01:49,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, UNASSIGN}] 2023-02-16 06:01:49,167 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, UNASSIGN 2023-02-16 06:01:49,168 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ae4bb67a788dc019286c4ea22f21bd59, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,168 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676527309168"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527309168"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527309168"}]},"ts":"1676527309168"} 2023-02-16 06:01:49,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ae4bb67a788dc019286c4ea22f21bd59, server=jenkins-hbase4.apache.org,46007,1676527305778}] 2023-02-16 06:01:49,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:01:49,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:49,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ae4bb67a788dc019286c4ea22f21bd59, disabling compactions & flushes 2023-02-16 06:01:49,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. after waiting 0 ms 2023-02-16 06:01:49,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:49,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59. 2023-02-16 06:01:49,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ae4bb67a788dc019286c4ea22f21bd59: 2023-02-16 06:01:49,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:49,335 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ae4bb67a788dc019286c4ea22f21bd59, regionState=CLOSED 2023-02-16 06:01:49,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676527309335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527309335"}]},"ts":"1676527309335"} 2023-02-16 06:01:49,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 06:01:49,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ae4bb67a788dc019286c4ea22f21bd59, server=jenkins-hbase4.apache.org,46007,1676527305778 in 169 msec 2023-02-16 06:01:49,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 06:01:49,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ae4bb67a788dc019286c4ea22f21bd59, UNASSIGN in 182 msec 2023-02-16 06:01:49,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527309350"}]},"ts":"1676527309350"} 2023-02-16 06:01:49,351 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-16 06:01:49,355 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-16 06:01:49,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 200 msec 2023-02-16 06:01:49,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:01:49,462 INFO [Listener at localhost/33863] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-16 06:01:49,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:01:49,470 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:49,472 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1, FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2, FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/recovered.edits] 2023-02-16 06:01:49,475 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/10d44fa6316442d7991476f7ee3c0800 to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/archive/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/10d44fa6316442d7991476f7ee3c0800 2023-02-16 06:01:49,477 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/52b933e6e11e423297c5143d1fedfcb2 to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/archive/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f1/52b933e6e11e423297c5143d1fedfcb2 2023-02-16 06:01:49,480 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/3c152af8b3094671ab031ab54d062259 to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/archive/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/3c152af8b3094671ab031ab54d062259 2023-02-16 06:01:49,481 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/a42f22f1e1444b35aa905285859801bd to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/archive/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/f2/a42f22f1e1444b35aa905285859801bd 2023-02-16 06:01:49,485 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/recovered.edits/12.seqid to hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/archive/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59/recovered.edits/12.seqid 2023-02-16 06:01:49,485 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ae4bb67a788dc019286c4ea22f21bd59 2023-02-16 06:01:49,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 06:01:49,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,489 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-16 06:01:49,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-16 06:01:49,492 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,492 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-16 06:01:49,493 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527309493"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:49,494 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 06:01:49,494 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ae4bb67a788dc019286c4ea22f21bd59, NAME => 'testInitTableSnapshotMapperJobConfig,,1676527306812.ae4bb67a788dc019286c4ea22f21bd59.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 06:01:49,494 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-16 06:01:49,494 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676527309494"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:49,498 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-16 06:01:49,500 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 06:01:49,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 37 msec 2023-02-16 06:01:49,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33027] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:01:49,569 INFO [Listener at localhost/33863] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-16 06:01:49,569 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:01:49,569 INFO [Listener at localhost/33863] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:01:49,569 DEBUG [Listener at localhost/33863] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45a4388c to 127.0.0.1:56550 2023-02-16 06:01:49,569 DEBUG [Listener at localhost/33863] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,569 DEBUG [Listener at localhost/33863] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:01:49,569 DEBUG [Listener at localhost/33863] util.JVMClusterUtil(257): Found active master hash=1799263479, stopped=false 2023-02-16 06:01:49,570 INFO [Listener at localhost/33863] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:49,572 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:49,572 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:49,572 INFO [Listener at localhost/33863] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:01:49,572 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:49,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:49,574 DEBUG [Listener at localhost/33863] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x293eda00 to 127.0.0.1:56550 2023-02-16 06:01:49,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:49,574 DEBUG [Listener at localhost/33863] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,574 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:49,575 INFO [Listener at localhost/33863] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36743,1676527305754' ***** 2023-02-16 06:01:49,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:49,575 INFO [Listener at localhost/33863] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:49,575 INFO [Listener at localhost/33863] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46007,1676527305778' ***** 2023-02-16 06:01:49,575 INFO [Listener at localhost/33863] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:49,575 INFO [RS:0;jenkins-hbase4:36743] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:49,575 INFO [RS:1;jenkins-hbase4:46007] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:49,575 INFO [RS:1;jenkins-hbase4:46007] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:49,575 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:49,576 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:49,576 INFO [RS:1;jenkins-hbase4:46007] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:49,576 INFO [RS:0;jenkins-hbase4:36743] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:49,577 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(3304): Received CLOSE for 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:49,577 INFO [RS:0;jenkins-hbase4:36743] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:49,577 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,577 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,577 DEBUG [RS:1;jenkins-hbase4:46007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c6e13f5 to 127.0.0.1:56550 2023-02-16 06:01:49,577 DEBUG [RS:0;jenkins-hbase4:36743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cf323a6 to 127.0.0.1:56550 2023-02-16 06:01:49,578 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 27b03e527f0f4a65b320688d7ecd7cb9, disabling compactions & flushes 2023-02-16 06:01:49,578 INFO [RS:1;jenkins-hbase4:46007] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:49,578 DEBUG [RS:0;jenkins-hbase4:36743] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,578 INFO [RS:1;jenkins-hbase4:46007] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:49,578 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36743,1676527305754; all regions closed. 2023-02-16 06:01:49,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:49,578 INFO [RS:1;jenkins-hbase4:46007] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:49,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:49,578 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:01:49,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. after waiting 0 ms 2023-02-16 06:01:49,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:49,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 27b03e527f0f4a65b320688d7ecd7cb9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:01:49,578 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 06:01:49,578 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 27b03e527f0f4a65b320688d7ecd7cb9=hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9.} 2023-02-16 06:01:49,578 DEBUG [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1505): Waiting on 1588230740, 27b03e527f0f4a65b320688d7ecd7cb9 2023-02-16 06:01:49,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:49,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:49,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:49,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:49,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:49,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-16 06:01:49,584 DEBUG [RS:0;jenkins-hbase4:36743] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/oldWALs 2023-02-16 06:01:49,584 INFO [RS:0;jenkins-hbase4:36743] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36743%2C1676527305754:(num 1676527307066) 2023-02-16 06:01:49,584 DEBUG [RS:0;jenkins-hbase4:36743] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,584 INFO [RS:0;jenkins-hbase4:36743] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:49,584 INFO [RS:0;jenkins-hbase4:36743] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:49,584 INFO [RS:0;jenkins-hbase4:36743] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:49,584 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:49,584 INFO [RS:0;jenkins-hbase4:36743] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:49,585 INFO [RS:0;jenkins-hbase4:36743] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:49,585 INFO [RS:0;jenkins-hbase4:36743] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36743 2023-02-16 06:01:49,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/.tmp/info/63ccd09d39ae49ceba15f623a52cc586 2023-02-16 06:01:49,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/.tmp/info/794567b8382a47fca835ab880c33dc96 2023-02-16 06:01:49,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/.tmp/info/63ccd09d39ae49ceba15f623a52cc586 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/info/63ccd09d39ae49ceba15f623a52cc586 2023-02-16 06:01:49,627 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 794567b8382a47fca835ab880c33dc96 2023-02-16 06:01:49,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/info/63ccd09d39ae49ceba15f623a52cc586, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:01:49,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 27b03e527f0f4a65b320688d7ecd7cb9 in 53ms, sequenceid=6, compaction requested=false 2023-02-16 06:01:49,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/namespace/27b03e527f0f4a65b320688d7ecd7cb9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:01:49,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 27b03e527f0f4a65b320688d7ecd7cb9: 2023-02-16 06:01:49,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527306322.27b03e527f0f4a65b320688d7ecd7cb9. 2023-02-16 06:01:49,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/.tmp/rep_barrier/55e15db3e0a343c380c3091353bc2b57 2023-02-16 06:01:49,662 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:49,662 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:49,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55e15db3e0a343c380c3091353bc2b57 2023-02-16 06:01:49,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/.tmp/table/90af5b073bc8473f9a53b2d2406a2893 2023-02-16 06:01:49,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90af5b073bc8473f9a53b2d2406a2893 2023-02-16 06:01:49,680 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/.tmp/info/794567b8382a47fca835ab880c33dc96 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/info/794567b8382a47fca835ab880c33dc96 2023-02-16 06:01:49,682 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,682 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36743,1676527305754 2023-02-16 06:01:49,683 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@508126ca rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:49,682 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:49,683 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:49,683 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:49,683 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@790920e7 rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:49,684 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36743,1676527305754] 2023-02-16 06:01:49,684 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36743,1676527305754; numProcessing=1 2023-02-16 06:01:49,685 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36743,1676527305754 already deleted, retry=false 2023-02-16 06:01:49,685 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36743,1676527305754 expired; onlineServers=1 2023-02-16 06:01:49,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 794567b8382a47fca835ab880c33dc96 2023-02-16 06:01:49,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/info/794567b8382a47fca835ab880c33dc96, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 06:01:49,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/.tmp/rep_barrier/55e15db3e0a343c380c3091353bc2b57 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/rep_barrier/55e15db3e0a343c380c3091353bc2b57 2023-02-16 06:01:49,691 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55e15db3e0a343c380c3091353bc2b57 2023-02-16 06:01:49,691 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/rep_barrier/55e15db3e0a343c380c3091353bc2b57, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 06:01:49,692 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/.tmp/table/90af5b073bc8473f9a53b2d2406a2893 as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/table/90af5b073bc8473f9a53b2d2406a2893 2023-02-16 06:01:49,696 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90af5b073bc8473f9a53b2d2406a2893 2023-02-16 06:01:49,696 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/table/90af5b073bc8473f9a53b2d2406a2893, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 06:01:49,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 118ms, sequenceid=21, compaction requested=false 2023-02-16 06:01:49,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 06:01:49,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:01:49,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:49,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:49,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:49,778 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46007,1676527305778; all regions closed. 2023-02-16 06:01:49,786 DEBUG [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/oldWALs 2023-02-16 06:01:49,786 INFO [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46007%2C1676527305778.meta:.meta(num 1676527306266) 2023-02-16 06:01:49,792 DEBUG [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/oldWALs 2023-02-16 06:01:49,792 INFO [RS:1;jenkins-hbase4:46007] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46007%2C1676527305778:(num 1676527306667) 2023-02-16 06:01:49,792 DEBUG [RS:1;jenkins-hbase4:46007] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,792 INFO [RS:1;jenkins-hbase4:46007] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:49,792 INFO [RS:1;jenkins-hbase4:46007] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:49,792 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:49,793 INFO [RS:1;jenkins-hbase4:46007] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46007 2023-02-16 06:01:49,796 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:49,796 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46007,1676527305778 2023-02-16 06:01:49,796 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@699bab5d rejected from java.util.concurrent.ThreadPoolExecutor@6da422b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:49,798 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46007,1676527305778] 2023-02-16 06:01:49,798 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46007,1676527305778; numProcessing=2 2023-02-16 06:01:49,801 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46007,1676527305778 already deleted, retry=false 2023-02-16 06:01:49,801 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46007,1676527305778 expired; onlineServers=0 2023-02-16 06:01:49,801 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33027,1676527305716' ***** 2023-02-16 06:01:49,801 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:01:49,801 DEBUG [M:0;jenkins-hbase4:33027] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f011d48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:49,801 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33027,1676527305716 2023-02-16 06:01:49,801 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33027,1676527305716; all regions closed. 2023-02-16 06:01:49,801 DEBUG [M:0;jenkins-hbase4:33027] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:49,801 DEBUG [M:0;jenkins-hbase4:33027] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:01:49,801 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:01:49,802 DEBUG [M:0;jenkins-hbase4:33027] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:01:49,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527305919] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527305919,5,FailOnTimeoutGroup] 2023-02-16 06:01:49,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527305919] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527305919,5,FailOnTimeoutGroup] 2023-02-16 06:01:49,802 INFO [M:0;jenkins-hbase4:33027] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:01:49,803 INFO [M:0;jenkins-hbase4:33027] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:01:49,803 INFO [M:0;jenkins-hbase4:33027] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:01:49,803 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:49,803 DEBUG [M:0;jenkins-hbase4:33027] master.HMaster(1512): Stopping service threads 2023-02-16 06:01:49,803 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:49,803 INFO [M:0;jenkins-hbase4:33027] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:01:49,804 ERROR [M:0;jenkins-hbase4:33027] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:01:49,804 INFO [M:0;jenkins-hbase4:33027] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:01:49,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:49,804 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:01:49,804 DEBUG [M:0;jenkins-hbase4:33027] zookeeper.ZKUtil(398): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 06:01:49,804 WARN [M:0;jenkins-hbase4:33027] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 06:01:49,804 INFO [M:0;jenkins-hbase4:33027] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:01:49,805 INFO [M:0;jenkins-hbase4:33027] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:01:49,805 DEBUG [M:0;jenkins-hbase4:33027] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:49,805 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:49,805 DEBUG [M:0;jenkins-hbase4:33027] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:49,805 DEBUG [M:0;jenkins-hbase4:33027] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:49,805 DEBUG [M:0;jenkins-hbase4:33027] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:49,805 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-16 06:01:49,818 INFO [M:0;jenkins-hbase4:33027] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2c0b2d86141b49f5b1b8015ae44fd8ad 2023-02-16 06:01:49,823 DEBUG [M:0;jenkins-hbase4:33027] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2c0b2d86141b49f5b1b8015ae44fd8ad as hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2c0b2d86141b49f5b1b8015ae44fd8ad 2023-02-16 06:01:49,828 INFO [M:0;jenkins-hbase4:33027] regionserver.HStore(1080): Added hdfs://localhost:33547/user/jenkins/test-data/5952c6ac-cccb-0851-9082-b0fc59e011db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2c0b2d86141b49f5b1b8015ae44fd8ad, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 06:01:49,829 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57232, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false 2023-02-16 06:01:49,829 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:49,829 DEBUG [M:0;jenkins-hbase4:33027] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:49,833 INFO [M:0;jenkins-hbase4:33027] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:01:49,833 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:49,834 INFO [M:0;jenkins-hbase4:33027] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33027 2023-02-16 06:01:49,835 DEBUG [M:0;jenkins-hbase4:33027] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33027,1676527305716 already deleted, retry=false 2023-02-16 06:01:49,972 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:49,972 INFO [M:0;jenkins-hbase4:33027] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33027,1676527305716; zookeeper connection closed. 2023-02-16 06:01:49,973 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@61476b0c rejected from java.util.concurrent.ThreadPoolExecutor@6578f3fc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:49,973 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): master:33027-0x1005bb86da80000, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:49,973 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b55c94c rejected from java.util.concurrent.ThreadPoolExecutor@6578f3fc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:50,073 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:50,073 INFO [RS:1;jenkins-hbase4:46007] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46007,1676527305778; zookeeper connection closed. 2023-02-16 06:01:50,073 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2db1cfcd rejected from java.util.concurrent.ThreadPoolExecutor@6da422b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:50,073 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:46007-0x1005bb86da80002, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:50,073 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e37e2c1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e37e2c1 2023-02-16 06:01:50,073 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55397879 rejected from java.util.concurrent.ThreadPoolExecutor@6da422b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:50,173 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:50,173 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b8acdc rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:50,173 DEBUG [Listener at localhost/33863-EventThread] zookeeper.ZKWatcher(600): regionserver:36743-0x1005bb86da80001, quorum=127.0.0.1:56550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:50,173 ERROR [Listener at localhost/33863-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@412ddb73 rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:50,173 INFO [RS:0;jenkins-hbase4:36743] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36743,1676527305754; zookeeper connection closed. 2023-02-16 06:01:50,174 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45b47775] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45b47775 2023-02-16 06:01:50,174 INFO [Listener at localhost/33863] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:01:50,174 WARN [Listener at localhost/33863] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:50,186 INFO [Listener at localhost/33863] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:50,296 WARN [BP-456569365-172.31.14.131-1676527305051 heartbeating to localhost/127.0.0.1:33547] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:50,296 WARN [BP-456569365-172.31.14.131-1676527305051 heartbeating to localhost/127.0.0.1:33547] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-456569365-172.31.14.131-1676527305051 (Datanode Uuid 5329ed0d-26b9-480e-b162-0c4eabd19319) service to localhost/127.0.0.1:33547 2023-02-16 06:01:50,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/dfs/data/data3/current/BP-456569365-172.31.14.131-1676527305051] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:50,298 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/dfs/data/data4/current/BP-456569365-172.31.14.131-1676527305051] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:50,299 WARN [Listener at localhost/33863] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:50,302 INFO [Listener at localhost/33863] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:50,410 WARN [BP-456569365-172.31.14.131-1676527305051 heartbeating to localhost/127.0.0.1:33547] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:50,410 WARN [BP-456569365-172.31.14.131-1676527305051 heartbeating to localhost/127.0.0.1:33547] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-456569365-172.31.14.131-1676527305051 (Datanode Uuid 92c70ff3-438c-4995-aa41-2d0de902403e) service to localhost/127.0.0.1:33547 2023-02-16 06:01:50,413 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/dfs/data/data1/current/BP-456569365-172.31.14.131-1676527305051] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:50,413 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/cluster_6ad2d78f-440c-0378-852c-5e584df2a733/dfs/data/data2/current/BP-456569365-172.31.14.131-1676527305051] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:50,430 INFO [Listener at localhost/33863] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:50,543 INFO [Listener at localhost/33863] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:01:50,564 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:01:50,576 INFO [Listener at localhost/33863] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 158) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33547 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33027,1676527305716)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:33547 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33547 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33547 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:33547 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33863 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:33547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=574 (was 545) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=366 (was 302) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1882 (was 2018) 2023-02-16 06:01:50,586 INFO [Listener at localhost/33863] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=574, MaxFileDescriptor=60000, SystemLoadAverage=366, ProcessCount=168, AvailableMemoryMB=1882 2023-02-16 06:01:50,597 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/hadoop.log.dir so I do NOT create it in target/test-data/a286fe5d-71c8-491c-2046-3291c623a574 2023-02-16 06:01:50,597 WARN [Listener at localhost/33863] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 06:01:50,597 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/hadoop.tmp.dir so I do NOT create it in target/test-data/a286fe5d-71c8-491c-2046-3291c623a574 2023-02-16 06:01:50,597 WARN [Listener at localhost/33863] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/56ea45e9-501e-113f-96e5-78f606145e30/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 06:01:50,597 DEBUG [Listener at localhost/33863] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574 2023-02-16 06:01:50,597 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:01:50,597 INFO [Listener at localhost/33863] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63, deleteOnExit=true 2023-02-16 06:01:50,597 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/test.cache.data in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:01:50,598 DEBUG [Listener at localhost/33863] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:50,598 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:01:50,599 INFO [Listener at localhost/33863] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:01:50,604 WARN [Listener at localhost/33863] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:50,604 WARN [Listener at localhost/33863] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:50,645 WARN [Listener at localhost/33863] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:50,647 INFO [Listener at localhost/33863] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:50,653 INFO [Listener at localhost/33863] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/java.io.tmpdir/Jetty_localhost_40449_hdfs____.16wyop/webapp 2023-02-16 06:01:50,744 INFO [Listener at localhost/33863] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40449 2023-02-16 06:01:50,749 WARN [Listener at localhost/33863] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:50,749 WARN [Listener at localhost/33863] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:50,793 WARN [Listener at localhost/35921] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:50,809 WARN [Listener at localhost/35921] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:50,812 WARN [Listener at localhost/35921] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:50,813 INFO [Listener at localhost/35921] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:50,819 INFO [Listener at localhost/35921] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/java.io.tmpdir/Jetty_localhost_34097_datanode____.a62j4c/webapp 2023-02-16 06:01:50,919 INFO [Listener at localhost/35921] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34097 2023-02-16 06:01:50,926 WARN [Listener at localhost/45223] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:50,940 WARN [Listener at localhost/45223] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:50,942 WARN [Listener at localhost/45223] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:50,943 INFO [Listener at localhost/45223] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:50,947 INFO [Listener at localhost/45223] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/java.io.tmpdir/Jetty_localhost_39095_datanode____scm7t9/webapp 2023-02-16 06:01:51,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4dcab4fabde982c3: Processing first storage report for DS-dd043ce6-65a3-482f-a0d9-0d486e41506c from datanode d00ccf13-ea29-440a-acce-310ff89f6a62 2023-02-16 06:01:51,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4dcab4fabde982c3: from storage DS-dd043ce6-65a3-482f-a0d9-0d486e41506c node DatanodeRegistration(127.0.0.1:37923, datanodeUuid=d00ccf13-ea29-440a-acce-310ff89f6a62, infoPort=44453, infoSecurePort=0, ipcPort=45223, storageInfo=lv=-57;cid=testClusterID;nsid=1250162194;c=1676527310606), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:51,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4dcab4fabde982c3: Processing first storage report for DS-bc73f649-673d-4e59-b3ea-654a76266071 from datanode d00ccf13-ea29-440a-acce-310ff89f6a62 2023-02-16 06:01:51,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4dcab4fabde982c3: from storage DS-bc73f649-673d-4e59-b3ea-654a76266071 node DatanodeRegistration(127.0.0.1:37923, datanodeUuid=d00ccf13-ea29-440a-acce-310ff89f6a62, infoPort=44453, infoSecurePort=0, ipcPort=45223, storageInfo=lv=-57;cid=testClusterID;nsid=1250162194;c=1676527310606), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:51,046 INFO [Listener at localhost/45223] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39095 2023-02-16 06:01:51,053 WARN [Listener at localhost/44483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:51,145 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xffa0f1db42643043: Processing first storage report for DS-ddb182b3-e256-40a1-8c44-c310bb9c414b from datanode d3d04ccf-3cdd-4473-b3cd-4e119b8f95d9 2023-02-16 06:01:51,145 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xffa0f1db42643043: from storage DS-ddb182b3-e256-40a1-8c44-c310bb9c414b node DatanodeRegistration(127.0.0.1:39669, datanodeUuid=d3d04ccf-3cdd-4473-b3cd-4e119b8f95d9, infoPort=42151, infoSecurePort=0, ipcPort=44483, storageInfo=lv=-57;cid=testClusterID;nsid=1250162194;c=1676527310606), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:51,145 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xffa0f1db42643043: Processing first storage report for DS-c8046d53-a366-41f6-9b04-f1f597a3a46c from datanode d3d04ccf-3cdd-4473-b3cd-4e119b8f95d9 2023-02-16 06:01:51,145 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xffa0f1db42643043: from storage DS-c8046d53-a366-41f6-9b04-f1f597a3a46c node DatanodeRegistration(127.0.0.1:39669, datanodeUuid=d3d04ccf-3cdd-4473-b3cd-4e119b8f95d9, infoPort=42151, infoSecurePort=0, ipcPort=44483, storageInfo=lv=-57;cid=testClusterID;nsid=1250162194;c=1676527310606), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:51,163 DEBUG [Listener at localhost/44483] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574 2023-02-16 06:01:51,169 INFO [Listener at localhost/44483] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/zookeeper_0, clientPort=58053, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:01:51,170 INFO [Listener at localhost/44483] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58053 2023-02-16 06:01:51,171 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,172 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,192 INFO [Listener at localhost/44483] util.FSUtils(479): Created version file at hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee with version=8 2023-02-16 06:01:51,192 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,193 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,194 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/hbase-staging 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:51,196 INFO [Listener at localhost/44483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:51,197 INFO [Listener at localhost/44483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35819 2023-02-16 06:01:51,198 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,198 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,199 INFO [Listener at localhost/44483] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35819 connecting to ZooKeeper ensemble=127.0.0.1:58053 2023-02-16 06:01:51,209 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:358190x0, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:51,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35819-0x1005bb883020000 connected 2023-02-16 06:01:51,222 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:51,222 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:51,223 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:51,223 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35819 2023-02-16 06:01:51,223 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35819 2023-02-16 06:01:51,224 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35819 2023-02-16 06:01:51,224 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35819 2023-02-16 06:01:51,224 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35819 2023-02-16 06:01:51,224 INFO [Listener at localhost/44483] master.HMaster(444): hbase.rootdir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee, hbase.cluster.distributed=false 2023-02-16 06:01:51,236 INFO [Listener at localhost/44483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:51,237 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,237 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,237 INFO [Listener at localhost/44483] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:51,237 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,237 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:51,237 INFO [Listener at localhost/44483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:51,238 INFO [Listener at localhost/44483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38609 2023-02-16 06:01:51,238 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:51,239 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:51,239 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,240 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,241 INFO [Listener at localhost/44483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38609 connecting to ZooKeeper ensemble=127.0.0.1:58053 2023-02-16 06:01:51,244 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:386090x0, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:51,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38609-0x1005bb883020001 connected 2023-02-16 06:01:51,245 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:51,246 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:51,246 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:51,248 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38609 2023-02-16 06:01:51,248 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38609 2023-02-16 06:01:51,248 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38609 2023-02-16 06:01:51,248 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38609 2023-02-16 06:01:51,249 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38609 2023-02-16 06:01:51,259 INFO [Listener at localhost/44483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:51,259 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,260 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,260 INFO [Listener at localhost/44483] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:51,260 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:51,260 INFO [Listener at localhost/44483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:51,260 INFO [Listener at localhost/44483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:51,260 INFO [Listener at localhost/44483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40821 2023-02-16 06:01:51,261 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:51,262 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:51,262 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,263 INFO [Listener at localhost/44483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,264 INFO [Listener at localhost/44483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40821 connecting to ZooKeeper ensemble=127.0.0.1:58053 2023-02-16 06:01:51,267 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:408210x0, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:51,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40821-0x1005bb883020002 connected 2023-02-16 06:01:51,268 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:51,268 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:51,269 DEBUG [Listener at localhost/44483] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:51,269 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40821 2023-02-16 06:01:51,270 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40821 2023-02-16 06:01:51,270 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40821 2023-02-16 06:01:51,270 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40821 2023-02-16 06:01:51,270 DEBUG [Listener at localhost/44483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40821 2023-02-16 06:01:51,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,273 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:51,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,275 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:51,275 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:51,275 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,275 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:51,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:51,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35819,1676527311196 from backup master directory 2023-02-16 06:01:51,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:51,279 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,279 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:51,279 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:51,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/hbase.id with ID: 7c4ec566-4d89-4ae6-9b6f-93f7c7beef81 2023-02-16 06:01:51,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:51,300 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x02f6b419 to 127.0.0.1:58053 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:51,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@374ba819, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:51,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:51,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:01:51,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:51,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store-tmp 2023-02-16 06:01:51,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:51,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:51,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:51,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:51,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:51,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:51,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:51,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:51,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/WALs/jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35819%2C1676527311196, suffix=, logDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/WALs/jenkins-hbase4.apache.org,35819,1676527311196, archiveDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/oldWALs, maxLogs=10 2023-02-16 06:01:51,347 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK] 2023-02-16 06:01:51,348 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK] 2023-02-16 06:01:51,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/WALs/jenkins-hbase4.apache.org,35819,1676527311196/jenkins-hbase4.apache.org%2C35819%2C1676527311196.1676527311333 2023-02-16 06:01:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK], DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK]] 2023-02-16 06:01:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:51,352 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:51,353 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:01:51,353 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:01:51,354 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:51,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:51,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:51,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:51,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61747637, jitterRate=-0.07988850772380829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:51,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:51,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:01:51,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:01:51,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:01:51,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:01:51,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 06:01:51,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 06:01:51,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:01:51,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:01:51,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:01:51,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:01:51,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:01:51,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:01:51,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:01:51,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:01:51,382 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:01:51,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:01:51,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:01:51,385 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:51,385 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:51,385 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,385 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:51,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35819,1676527311196, sessionid=0x1005bb883020000, setting cluster-up flag (Was=false) 2023-02-16 06:01:51,392 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:01:51,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,400 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:01:51,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:51,406 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.hbase-snapshot/.tmp 2023-02-16 06:01:51,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:51,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:51,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527341410 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:01:51,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,411 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:51,411 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:01:51,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:01:51,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:01:51,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:01:51,413 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:51,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:01:51,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:01:51,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527311416,5,FailOnTimeoutGroup] 2023-02-16 06:01:51,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527311416,5,FailOnTimeoutGroup] 2023-02-16 06:01:51,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:01:51,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,423 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:51,423 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:51,424 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee 2023-02-16 06:01:51,432 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:51,433 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:51,435 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/info 2023-02-16 06:01:51,435 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:51,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:51,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:51,438 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:51,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:51,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/table 2023-02-16 06:01:51,440 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:51,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,441 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740 2023-02-16 06:01:51,441 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740 2023-02-16 06:01:51,443 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:51,444 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:51,446 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:51,446 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73956368, jitterRate=0.1020357608795166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:51,446 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:51,446 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:51,446 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:51,446 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:51,446 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:51,446 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:51,447 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:51,447 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:51,448 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:51,448 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:01:51,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:01:51,449 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:01:51,451 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:01:51,472 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(952): ClusterId : 7c4ec566-4d89-4ae6-9b6f-93f7c7beef81 2023-02-16 06:01:51,473 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(952): ClusterId : 7c4ec566-4d89-4ae6-9b6f-93f7c7beef81 2023-02-16 06:01:51,473 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:51,473 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:51,475 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:51,475 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:51,475 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:51,475 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:51,477 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:51,478 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:51,480 DEBUG [RS:0;jenkins-hbase4:38609] zookeeper.ReadOnlyZKClient(139): Connect 0x1361642d to 127.0.0.1:58053 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:51,480 DEBUG [RS:1;jenkins-hbase4:40821] zookeeper.ReadOnlyZKClient(139): Connect 0x7e34c18f to 127.0.0.1:58053 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:51,486 DEBUG [RS:0;jenkins-hbase4:38609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@175ee299, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:51,486 DEBUG [RS:1;jenkins-hbase4:40821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b36402d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:51,486 DEBUG [RS:0;jenkins-hbase4:38609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@525c6e16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:51,486 DEBUG [RS:1;jenkins-hbase4:40821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a3c8ee6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:51,500 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40821 2023-02-16 06:01:51,500 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38609 2023-02-16 06:01:51,501 INFO [RS:1;jenkins-hbase4:40821] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:51,501 INFO [RS:1;jenkins-hbase4:40821] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:51,501 INFO [RS:0;jenkins-hbase4:38609] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:51,501 INFO [RS:0;jenkins-hbase4:38609] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:51,501 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:51,501 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:51,501 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35819,1676527311196 with isa=jenkins-hbase4.apache.org/172.31.14.131:40821, startcode=1676527311259 2023-02-16 06:01:51,501 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35819,1676527311196 with isa=jenkins-hbase4.apache.org/172.31.14.131:38609, startcode=1676527311236 2023-02-16 06:01:51,501 DEBUG [RS:1;jenkins-hbase4:40821] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:51,501 DEBUG [RS:0;jenkins-hbase4:38609] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:51,504 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44093, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:51,505 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46563, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:51,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,506 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee 2023-02-16 06:01:51,506 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35921 2023-02-16 06:01:51,506 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:51,506 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee 2023-02-16 06:01:51,506 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35921 2023-02-16 06:01:51,507 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:51,508 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:51,516 DEBUG [RS:1;jenkins-hbase4:40821] zookeeper.ZKUtil(162): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,516 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38609,1676527311236] 2023-02-16 06:01:51,516 WARN [RS:1;jenkins-hbase4:40821] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:51,516 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40821,1676527311259] 2023-02-16 06:01:51,517 INFO [RS:1;jenkins-hbase4:40821] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:51,517 DEBUG [RS:0;jenkins-hbase4:38609] zookeeper.ZKUtil(162): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,517 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,517 WARN [RS:0;jenkins-hbase4:38609] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:51,517 INFO [RS:0;jenkins-hbase4:38609] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:51,517 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,523 DEBUG [RS:1;jenkins-hbase4:40821] zookeeper.ZKUtil(162): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,523 DEBUG [RS:0;jenkins-hbase4:38609] zookeeper.ZKUtil(162): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,523 DEBUG [RS:1;jenkins-hbase4:40821] zookeeper.ZKUtil(162): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,523 DEBUG [RS:0;jenkins-hbase4:38609] zookeeper.ZKUtil(162): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,524 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:51,524 DEBUG [RS:1;jenkins-hbase4:40821] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:51,524 INFO [RS:0;jenkins-hbase4:38609] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:51,524 INFO [RS:1;jenkins-hbase4:40821] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:51,526 INFO [RS:0;jenkins-hbase4:38609] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:51,527 INFO [RS:0;jenkins-hbase4:38609] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:51,527 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,527 INFO [RS:1;jenkins-hbase4:40821] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:51,527 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:51,528 INFO [RS:1;jenkins-hbase4:40821] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:51,528 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,529 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:51,529 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,530 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,530 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,530 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:51,530 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:51,531 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:0;jenkins-hbase4:38609] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,531 DEBUG [RS:1;jenkins-hbase4:40821] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:51,536 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,536 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,536 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,537 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,537 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,537 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,548 INFO [RS:1;jenkins-hbase4:40821] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:51,548 INFO [RS:0;jenkins-hbase4:38609] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:51,548 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40821,1676527311259-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,549 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38609,1676527311236-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,559 INFO [RS:1;jenkins-hbase4:40821] regionserver.Replication(203): jenkins-hbase4.apache.org,40821,1676527311259 started 2023-02-16 06:01:51,559 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40821,1676527311259, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40821, sessionid=0x1005bb883020002 2023-02-16 06:01:51,560 INFO [RS:0;jenkins-hbase4:38609] regionserver.Replication(203): jenkins-hbase4.apache.org,38609,1676527311236 started 2023-02-16 06:01:51,560 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:51,560 DEBUG [RS:1;jenkins-hbase4:40821] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,560 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38609,1676527311236, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38609, sessionid=0x1005bb883020001 2023-02-16 06:01:51,560 DEBUG [RS:1;jenkins-hbase4:40821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40821,1676527311259' 2023-02-16 06:01:51,560 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:51,560 DEBUG [RS:0;jenkins-hbase4:38609] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,560 DEBUG [RS:0;jenkins-hbase4:38609] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38609,1676527311236' 2023-02-16 06:01:51,560 DEBUG [RS:0;jenkins-hbase4:38609] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:51,560 DEBUG [RS:1;jenkins-hbase4:40821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:51,560 DEBUG [RS:0;jenkins-hbase4:38609] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:51,560 DEBUG [RS:1;jenkins-hbase4:40821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:51,561 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:51,561 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:51,561 DEBUG [RS:0;jenkins-hbase4:38609] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,561 DEBUG [RS:0;jenkins-hbase4:38609] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38609,1676527311236' 2023-02-16 06:01:51,561 DEBUG [RS:0;jenkins-hbase4:38609] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:51,561 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:51,561 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:51,561 DEBUG [RS:1;jenkins-hbase4:40821] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:51,561 DEBUG [RS:1;jenkins-hbase4:40821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40821,1676527311259' 2023-02-16 06:01:51,561 DEBUG [RS:1;jenkins-hbase4:40821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:51,561 DEBUG [RS:0;jenkins-hbase4:38609] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:51,561 DEBUG [RS:1;jenkins-hbase4:40821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:51,562 DEBUG [RS:0;jenkins-hbase4:38609] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:51,562 INFO [RS:0;jenkins-hbase4:38609] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:51,562 INFO [RS:0;jenkins-hbase4:38609] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:51,562 DEBUG [RS:1;jenkins-hbase4:40821] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:51,562 INFO [RS:1;jenkins-hbase4:40821] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:51,562 INFO [RS:1;jenkins-hbase4:40821] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:51,601 DEBUG [jenkins-hbase4:35819] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:01:51,601 DEBUG [jenkins-hbase4:35819] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:51,603 DEBUG [jenkins-hbase4:35819] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:51,603 DEBUG [jenkins-hbase4:35819] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:51,603 DEBUG [jenkins-hbase4:35819] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:51,604 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38609,1676527311236, state=OPENING 2023-02-16 06:01:51,605 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:01:51,606 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:51,607 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:51,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:51,761 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:51,761 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:51,763 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:51,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:01:51,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:51,768 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38609%2C1676527311236.meta, suffix=.meta, logDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,38609,1676527311236, archiveDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/oldWALs, maxLogs=32 2023-02-16 06:01:51,784 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK] 2023-02-16 06:01:51,785 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK] 2023-02-16 06:01:51,786 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,38609,1676527311236/jenkins-hbase4.apache.org%2C38609%2C1676527311236.meta.1676527311768.meta 2023-02-16 06:01:51,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK], DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK]] 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:01:51,787 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:01:51,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:01:51,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:51,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/info 2023-02-16 06:01:51,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/info 2023-02-16 06:01:51,790 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:51,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:51,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:51,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:51,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:51,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:51,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/table 2023-02-16 06:01:51,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/table 2023-02-16 06:01:51,793 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:51,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:51,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740 2023-02-16 06:01:51,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740 2023-02-16 06:01:51,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:51,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:51,798 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74720777, jitterRate=0.1134263426065445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:51,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:51,799 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527311761 2023-02-16 06:01:51,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:01:51,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:01:51,805 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38609,1676527311236, state=OPEN 2023-02-16 06:01:51,806 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:01:51,806 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:51,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:01:51,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38609,1676527311236 in 199 msec 2023-02-16 06:01:51,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:01:51,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-16 06:01:51,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 404 msec 2023-02-16 06:01:51,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527311811, completionTime=-1 2023-02-16 06:01:51,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:01:51,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:01:51,814 DEBUG [hconnection-0x5fb30977-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:51,816 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:51,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:01:51,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527371817 2023-02-16 06:01:51,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527431818 2023-02-16 06:01:51,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-16 06:01:51,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35819,1676527311196-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35819,1676527311196-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35819,1676527311196-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35819, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:51,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:01:51,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:51,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:01:51,827 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:01:51,828 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:51,828 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:51,830 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:51,831 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84 empty. 2023-02-16 06:01:51,831 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:51,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:01:51,845 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:51,846 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 320fc30ebe116699bd23092cc5865d84, NAME => 'hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:51,861 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:51,861 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 320fc30ebe116699bd23092cc5865d84, disabling compactions & flushes 2023-02-16 06:01:51,861 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:51,861 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:51,861 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. after waiting 0 ms 2023-02-16 06:01:51,861 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:51,861 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:51,861 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 320fc30ebe116699bd23092cc5865d84: 2023-02-16 06:01:51,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:51,865 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527311864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527311864"}]},"ts":"1676527311864"} 2023-02-16 06:01:51,867 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:01:51,868 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:51,868 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527311868"}]},"ts":"1676527311868"} 2023-02-16 06:01:51,870 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:01:51,873 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:51,874 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:51,874 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:51,874 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:51,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=320fc30ebe116699bd23092cc5865d84, ASSIGN}] 2023-02-16 06:01:51,879 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=320fc30ebe116699bd23092cc5865d84, ASSIGN 2023-02-16 06:01:51,880 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=320fc30ebe116699bd23092cc5865d84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38609,1676527311236; forceNewPlan=false, retain=false 2023-02-16 06:01:52,031 INFO [jenkins-hbase4:35819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:01:52,032 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=320fc30ebe116699bd23092cc5865d84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527312032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312032"}]},"ts":"1676527312032"} 2023-02-16 06:01:52,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 320fc30ebe116699bd23092cc5865d84, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:52,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:01:52,190 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:52,192 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38609%2C1676527311236, suffix=, logDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,38609,1676527311236, archiveDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/oldWALs, maxLogs=32 2023-02-16 06:01:52,213 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK] 2023-02-16 06:01:52,213 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK] 2023-02-16 06:01:52,223 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,38609,1676527311236/jenkins-hbase4.apache.org%2C38609%2C1676527311236.1676527312193 2023-02-16 06:01:52,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK], DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK]] 2023-02-16 06:01:52,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 320fc30ebe116699bd23092cc5865d84, NAME => 'hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:52,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,226 INFO [StoreOpener-320fc30ebe116699bd23092cc5865d84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,227 DEBUG [StoreOpener-320fc30ebe116699bd23092cc5865d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/info 2023-02-16 06:01:52,227 DEBUG [StoreOpener-320fc30ebe116699bd23092cc5865d84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/info 2023-02-16 06:01:52,228 INFO [StoreOpener-320fc30ebe116699bd23092cc5865d84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 320fc30ebe116699bd23092cc5865d84 columnFamilyName info 2023-02-16 06:01:52,228 INFO [StoreOpener-320fc30ebe116699bd23092cc5865d84-1] regionserver.HStore(310): Store=320fc30ebe116699bd23092cc5865d84/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,230 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:52,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 320fc30ebe116699bd23092cc5865d84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74974488, jitterRate=0.11720693111419678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:52,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 320fc30ebe116699bd23092cc5865d84: 2023-02-16 06:01:52,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84., pid=6, masterSystemTime=1676527312187 2023-02-16 06:01:52,241 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=320fc30ebe116699bd23092cc5865d84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,241 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:52,241 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:52,241 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527312240"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312240"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312240"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312240"}]},"ts":"1676527312240"} 2023-02-16 06:01:52,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:01:52,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 320fc30ebe116699bd23092cc5865d84, server=jenkins-hbase4.apache.org,38609,1676527311236 in 209 msec 2023-02-16 06:01:52,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:01:52,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=320fc30ebe116699bd23092cc5865d84, ASSIGN in 371 msec 2023-02-16 06:01:52,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:52,247 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527312247"}]},"ts":"1676527312247"} 2023-02-16 06:01:52,248 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:01:52,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:52,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 426 msec 2023-02-16 06:01:52,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:01:52,329 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:52,329 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:52,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:01:52,339 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:52,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-16 06:01:52,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:01:52,362 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:52,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-16 06:01:52,380 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:01:52,383 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:01:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.104sec 2023-02-16 06:01:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:01:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:01:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:01:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35819,1676527311196-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:01:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35819,1676527311196-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:01:52,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:01:52,473 DEBUG [Listener at localhost/44483] zookeeper.ReadOnlyZKClient(139): Connect 0x3b67361e to 127.0.0.1:58053 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:52,478 DEBUG [Listener at localhost/44483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f2ec6f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:52,479 DEBUG [hconnection-0x3ee43e76-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:52,481 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:52,483 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:52,483 DEBUG [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:01:52,484 DEBUG [Listener at localhost/44483] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:01:52,486 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:01:52,486 INFO [Listener at localhost/44483] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 06:01:52,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 06:01:52,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:01:52,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:53548 deadline: 1676527372487, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-16 06:01:52,488 INFO [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-16 06:01:52,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:52,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:52,492 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:52,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-16 06:01:52,493 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,500 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 empty. 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 empty. 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e empty. 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 empty. 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 empty. 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 empty. 2023-02-16 06:01:52,501 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 empty. 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f empty. 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 empty. 2023-02-16 06:01:52,502 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,503 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd empty. 2023-02-16 06:01:52,503 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,503 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,503 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,503 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 06:01:52,511 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:52,512 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c69fd28608f3217527519596c7dc33a1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,512 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9bb4fa3917a13dc7c150c99f75727a6e, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,512 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b1ed6fdf8d86e0bcebb6ff768865ccd3, NAME => 'testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c69fd28608f3217527519596c7dc33a1, disabling compactions & flushes 2023-02-16 06:01:52,521 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. after waiting 0 ms 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 9bb4fa3917a13dc7c150c99f75727a6e, disabling compactions & flushes 2023-02-16 06:01:52,521 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,521 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,521 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. after waiting 0 ms 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,522 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:52,522 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 480c4f6cefd642d467be931fa68dcad8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,522 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => b6fae2ed95adbc75574581e63dcf26a3, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b1ed6fdf8d86e0bcebb6ff768865ccd3, disabling compactions & flushes 2023-02-16 06:01:52,522 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. after waiting 0 ms 2023-02-16 06:01:52,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,522 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,523 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:52,523 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5d54b0efda9e64b101b17c8e82d1673f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,534 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,534 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing b6fae2ed95adbc75574581e63dcf26a3, disabling compactions & flushes 2023-02-16 06:01:52,534 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,534 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,534 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. after waiting 0 ms 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 480c4f6cefd642d467be931fa68dcad8, disabling compactions & flushes 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,535 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. after waiting 0 ms 2023-02-16 06:01:52,535 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:52,535 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,535 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:52,536 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9a4e8eda753846f54c0762dcfac76f41, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,536 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 5d54b0efda9e64b101b17c8e82d1673f, disabling compactions & flushes 2023-02-16 06:01:52,536 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 20b79761eadb9a95a00dc3df218f3676, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,536 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,536 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,536 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. after waiting 0 ms 2023-02-16 06:01:52,536 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,536 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,536 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:52,536 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6a2f08b3dd6807aab7d4f64fd2100ddd, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,549 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,549 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 20b79761eadb9a95a00dc3df218f3676, disabling compactions & flushes 2023-02-16 06:01:52,549 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. after waiting 0 ms 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,550 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 9a4e8eda753846f54c0762dcfac76f41, disabling compactions & flushes 2023-02-16 06:01:52,550 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. after waiting 0 ms 2023-02-16 06:01:52,550 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,550 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1ff9d03457dfa285ee7d71a79a2ec688, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp 2023-02-16 06:01:52,550 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,551 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:52,552 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,552 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 6a2f08b3dd6807aab7d4f64fd2100ddd, disabling compactions & flushes 2023-02-16 06:01:52,552 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,552 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,553 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. after waiting 0 ms 2023-02-16 06:01:52,553 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,553 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,553 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:52,559 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,559 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 1ff9d03457dfa285ee7d71a79a2ec688, disabling compactions & flushes 2023-02-16 06:01:52,559 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,559 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,559 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. after waiting 0 ms 2023-02-16 06:01:52,559 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,559 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,559 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:52,561 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:52,562 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,562 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527312562"}]},"ts":"1676527312562"} 2023-02-16 06:01:52,563 INFO [RS:1;jenkins-hbase4:40821] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40821%2C1676527311259, suffix=, logDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,40821,1676527311259, archiveDir=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/oldWALs, maxLogs=32 2023-02-16 06:01:52,565 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 06:01:52,566 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:52,566 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527312566"}]},"ts":"1676527312566"} 2023-02-16 06:01:52,567 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-16 06:01:52,569 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:52,575 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:52,575 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:52,575 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:52,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, ASSIGN}] 2023-02-16 06:01:52,579 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK] 2023-02-16 06:01:52,579 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK] 2023-02-16 06:01:52,580 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, ASSIGN 2023-02-16 06:01:52,580 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, ASSIGN 2023-02-16 06:01:52,580 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, ASSIGN 2023-02-16 06:01:52,581 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, ASSIGN 2023-02-16 06:01:52,581 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, ASSIGN 2023-02-16 06:01:52,581 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40821,1676527311259; forceNewPlan=false, retain=false 2023-02-16 06:01:52,581 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38609,1676527311236; forceNewPlan=false, retain=false 2023-02-16 06:01:52,581 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38609,1676527311236; forceNewPlan=false, retain=false 2023-02-16 06:01:52,581 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38609,1676527311236; forceNewPlan=false, retain=false 2023-02-16 06:01:52,582 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40821,1676527311259; forceNewPlan=false, retain=false 2023-02-16 06:01:52,582 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, ASSIGN 2023-02-16 06:01:52,582 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, ASSIGN 2023-02-16 06:01:52,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, ASSIGN 2023-02-16 06:01:52,582 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, ASSIGN 2023-02-16 06:01:52,583 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, ASSIGN 2023-02-16 06:01:52,583 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38609,1676527311236; forceNewPlan=false, retain=false 2023-02-16 06:01:52,583 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38609,1676527311236; forceNewPlan=false, retain=false 2023-02-16 06:01:52,583 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40821,1676527311259; forceNewPlan=false, retain=false 2023-02-16 06:01:52,583 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40821,1676527311259; forceNewPlan=false, retain=false 2023-02-16 06:01:52,583 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40821,1676527311259; forceNewPlan=false, retain=false 2023-02-16 06:01:52,584 INFO [RS:1;jenkins-hbase4:40821] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/WALs/jenkins-hbase4.apache.org,40821,1676527311259/jenkins-hbase4.apache.org%2C40821%2C1676527311259.1676527312563 2023-02-16 06:01:52,584 DEBUG [RS:1;jenkins-hbase4:40821] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39669,DS-ddb182b3-e256-40a1-8c44-c310bb9c414b,DISK], DatanodeInfoWithStorage[127.0.0.1:37923,DS-dd043ce6-65a3-482f-a0d9-0d486e41506c,DISK]] 2023-02-16 06:01:52,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:52,731 INFO [jenkins-hbase4:35819] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 06:01:52,737 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9bb4fa3917a13dc7c150c99f75727a6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,737 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b6fae2ed95adbc75574581e63dcf26a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,737 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1ff9d03457dfa285ee7d71a79a2ec688, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,737 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5d54b0efda9e64b101b17c8e82d1673f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,738 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312737"}]},"ts":"1676527312737"} 2023-02-16 06:01:52,738 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312737"}]},"ts":"1676527312737"} 2023-02-16 06:01:52,737 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9a4e8eda753846f54c0762dcfac76f41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527312737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312737"}]},"ts":"1676527312737"} 2023-02-16 06:01:52,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312737"}]},"ts":"1676527312737"} 2023-02-16 06:01:52,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312737"}]},"ts":"1676527312737"} 2023-02-16 06:01:52,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 9bb4fa3917a13dc7c150c99f75727a6e, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:52,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 5d54b0efda9e64b101b17c8e82d1673f, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:52,741 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure b6fae2ed95adbc75574581e63dcf26a3, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:52,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 9a4e8eda753846f54c0762dcfac76f41, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:52,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure 1ff9d03457dfa285ee7d71a79a2ec688, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:52,748 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6a2f08b3dd6807aab7d4f64fd2100ddd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,748 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312748"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312748"}]},"ts":"1676527312748"} 2023-02-16 06:01:52,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=480c4f6cefd642d467be931fa68dcad8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312749"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312749"}]},"ts":"1676527312749"} 2023-02-16 06:01:52,750 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b1ed6fdf8d86e0bcebb6ff768865ccd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,751 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527312750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312750"}]},"ts":"1676527312750"} 2023-02-16 06:01:52,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 6a2f08b3dd6807aab7d4f64fd2100ddd, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:52,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 480c4f6cefd642d467be931fa68dcad8, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:52,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=20b79761eadb9a95a00dc3df218f3676, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure b1ed6fdf8d86e0bcebb6ff768865ccd3, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:52,753 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312752"}]},"ts":"1676527312752"} 2023-02-16 06:01:52,754 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c69fd28608f3217527519596c7dc33a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,754 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527312754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527312754"}]},"ts":"1676527312754"} 2023-02-16 06:01:52,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 20b79761eadb9a95a00dc3df218f3676, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:52,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure c69fd28608f3217527519596c7dc33a1, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:52,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:52,892 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,892 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:52,894 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40636, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:52,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d54b0efda9e64b101b17c8e82d1673f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 06:01:52,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,900 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,901 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1 2023-02-16 06:01:52,901 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1 2023-02-16 06:01:52,901 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d54b0efda9e64b101b17c8e82d1673f columnFamilyName f1 2023-02-16 06:01:52,902 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(310): Store=5d54b0efda9e64b101b17c8e82d1673f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,902 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,903 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2 2023-02-16 06:01:52,903 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2 2023-02-16 06:01:52,903 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d54b0efda9e64b101b17c8e82d1673f columnFamilyName f2 2023-02-16 06:01:52,904 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(310): Store=5d54b0efda9e64b101b17c8e82d1673f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a2f08b3dd6807aab7d4f64fd2100ddd, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 06:01:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:52,908 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,909 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1 2023-02-16 06:01:52,909 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1 2023-02-16 06:01:52,910 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f08b3dd6807aab7d4f64fd2100ddd columnFamilyName f1 2023-02-16 06:01:52,910 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(310): Store=6a2f08b3dd6807aab7d4f64fd2100ddd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,910 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5d54b0efda9e64b101b17c8e82d1673f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74187137, jitterRate=0.10547448694705963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:52,911 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2 2023-02-16 06:01:52,912 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2 2023-02-16 06:01:52,912 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f08b3dd6807aab7d4f64fd2100ddd columnFamilyName f2 2023-02-16 06:01:52,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f., pid=22, masterSystemTime=1676527312892 2023-02-16 06:01:52,914 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(310): Store=6a2f08b3dd6807aab7d4f64fd2100ddd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:52,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ff9d03457dfa285ee7d71a79a2ec688, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 06:01:52,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5d54b0efda9e64b101b17c8e82d1673f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312916"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312916"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312916"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312916"}]},"ts":"1676527312916"} 2023-02-16 06:01:52,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:52,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-16 06:01:52,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 5d54b0efda9e64b101b17c8e82d1673f, server=jenkins-hbase4.apache.org,40821,1676527311259 in 177 msec 2023-02-16 06:01:52,920 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, ASSIGN in 343 msec 2023-02-16 06:01:52,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,921 DEBUG [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f1 2023-02-16 06:01:52,921 DEBUG [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f1 2023-02-16 06:01:52,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a2f08b3dd6807aab7d4f64fd2100ddd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64058768, jitterRate=-0.04544997215270996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:52,921 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff9d03457dfa285ee7d71a79a2ec688 columnFamilyName f1 2023-02-16 06:01:52,922 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(310): Store=1ff9d03457dfa285ee7d71a79a2ec688/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd., pid=26, masterSystemTime=1676527312904 2023-02-16 06:01:52,922 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,923 DEBUG [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f2 2023-02-16 06:01:52,923 DEBUG [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f2 2023-02-16 06:01:52,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:52,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6a2f08b3dd6807aab7d4f64fd2100ddd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c69fd28608f3217527519596c7dc33a1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 06:01:52,923 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff9d03457dfa285ee7d71a79a2ec688 columnFamilyName f2 2023-02-16 06:01:52,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312923"}]},"ts":"1676527312923"} 2023-02-16 06:01:52,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,924 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(310): Store=1ff9d03457dfa285ee7d71a79a2ec688/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,925 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-16 06:01:52,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 6a2f08b3dd6807aab7d4f64fd2100ddd, server=jenkins-hbase4.apache.org,38609,1676527311236 in 174 msec 2023-02-16 06:01:52,926 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1 2023-02-16 06:01:52,926 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1 2023-02-16 06:01:52,927 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c69fd28608f3217527519596c7dc33a1 columnFamilyName f1 2023-02-16 06:01:52,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,927 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(310): Store=c69fd28608f3217527519596c7dc33a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, ASSIGN in 350 msec 2023-02-16 06:01:52,927 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,928 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2 2023-02-16 06:01:52,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:52,928 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2 2023-02-16 06:01:52,929 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c69fd28608f3217527519596c7dc33a1 columnFamilyName f2 2023-02-16 06:01:52,929 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(310): Store=c69fd28608f3217527519596c7dc33a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1ff9d03457dfa285ee7d71a79a2ec688; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65615268, jitterRate=-0.022256314754486084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:52,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688., pid=24, masterSystemTime=1676527312892 2023-02-16 06:01:52,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:52,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:52,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b6fae2ed95adbc75574581e63dcf26a3, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 06:01:52,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1ff9d03457dfa285ee7d71a79a2ec688, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,933 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527312933"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312933"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312933"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312933"}]},"ts":"1676527312933"} 2023-02-16 06:01:52,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,934 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c69fd28608f3217527519596c7dc33a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71376423, jitterRate=0.06359158456325531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:52,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1., pid=30, masterSystemTime=1676527312904 2023-02-16 06:01:52,935 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1 2023-02-16 06:01:52,935 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1 2023-02-16 06:01:52,936 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6fae2ed95adbc75574581e63dcf26a3 columnFamilyName f1 2023-02-16 06:01:52,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-16 06:01:52,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure 1ff9d03457dfa285ee7d71a79a2ec688, server=jenkins-hbase4.apache.org,40821,1676527311259 in 192 msec 2023-02-16 06:01:52,936 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(310): Store=b6fae2ed95adbc75574581e63dcf26a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,936 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:52,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 480c4f6cefd642d467be931fa68dcad8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 06:01:52,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, ASSIGN in 360 msec 2023-02-16 06:01:52,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,937 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c69fd28608f3217527519596c7dc33a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,937 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312937"}]},"ts":"1676527312937"} 2023-02-16 06:01:52,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,938 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2 2023-02-16 06:01:52,938 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2 2023-02-16 06:01:52,938 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6fae2ed95adbc75574581e63dcf26a3 columnFamilyName f2 2023-02-16 06:01:52,938 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,939 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(310): Store=b6fae2ed95adbc75574581e63dcf26a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,939 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1 2023-02-16 06:01:52,939 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1 2023-02-16 06:01:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,940 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 480c4f6cefd642d467be931fa68dcad8 columnFamilyName f1 2023-02-16 06:01:52,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-16 06:01:52,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure c69fd28608f3217527519596c7dc33a1, server=jenkins-hbase4.apache.org,38609,1676527311236 in 181 msec 2023-02-16 06:01:52,940 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(310): Store=480c4f6cefd642d467be931fa68dcad8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,940 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, ASSIGN in 364 msec 2023-02-16 06:01:52,941 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2 2023-02-16 06:01:52,941 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2 2023-02-16 06:01:52,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,941 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 480c4f6cefd642d467be931fa68dcad8 columnFamilyName f2 2023-02-16 06:01:52,942 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(310): Store=480c4f6cefd642d467be931fa68dcad8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:52,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b6fae2ed95adbc75574581e63dcf26a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73643063, jitterRate=0.09736715257167816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:52,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:52,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3., pid=23, masterSystemTime=1676527312892 2023-02-16 06:01:52,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:52,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9bb4fa3917a13dc7c150c99f75727a6e, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 06:01:52,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,946 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b6fae2ed95adbc75574581e63dcf26a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,947 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312946"}]},"ts":"1676527312946"} 2023-02-16 06:01:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 480c4f6cefd642d467be931fa68dcad8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67529859, jitterRate=0.006273314356803894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:52,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8., pid=27, masterSystemTime=1676527312904 2023-02-16 06:01:52,948 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:52,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b1ed6fdf8d86e0bcebb6ff768865ccd3, NAME => 'testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 06:01:52,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=480c4f6cefd642d467be931fa68dcad8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312949"}]},"ts":"1676527312949"} 2023-02-16 06:01:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-16 06:01:52,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure b6fae2ed95adbc75574581e63dcf26a3, server=jenkins-hbase4.apache.org,40821,1676527311259 in 207 msec 2023-02-16 06:01:52,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, ASSIGN in 373 msec 2023-02-16 06:01:52,951 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1 2023-02-16 06:01:52,951 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,951 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1 2023-02-16 06:01:52,951 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bb4fa3917a13dc7c150c99f75727a6e columnFamilyName f1 2023-02-16 06:01:52,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-16 06:01:52,952 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(310): Store=9bb4fa3917a13dc7c150c99f75727a6e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 480c4f6cefd642d467be931fa68dcad8, server=jenkins-hbase4.apache.org,38609,1676527311236 in 199 msec 2023-02-16 06:01:52,952 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,952 DEBUG [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f1 2023-02-16 06:01:52,952 DEBUG [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f1 2023-02-16 06:01:52,953 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1ed6fdf8d86e0bcebb6ff768865ccd3 columnFamilyName f1 2023-02-16 06:01:52,953 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(310): Store=b1ed6fdf8d86e0bcebb6ff768865ccd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,953 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,953 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2 2023-02-16 06:01:52,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, ASSIGN in 376 msec 2023-02-16 06:01:52,954 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2 2023-02-16 06:01:52,954 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bb4fa3917a13dc7c150c99f75727a6e columnFamilyName f2 2023-02-16 06:01:52,954 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(310): Store=9bb4fa3917a13dc7c150c99f75727a6e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,955 DEBUG [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f2 2023-02-16 06:01:52,955 DEBUG [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f2 2023-02-16 06:01:52,955 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1ed6fdf8d86e0bcebb6ff768865ccd3 columnFamilyName f2 2023-02-16 06:01:52,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,956 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(310): Store=b1ed6fdf8d86e0bcebb6ff768865ccd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:52,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9bb4fa3917a13dc7c150c99f75727a6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72629916, jitterRate=0.08227008581161499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:52,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e., pid=21, masterSystemTime=1676527312892 2023-02-16 06:01:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:52,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9a4e8eda753846f54c0762dcfac76f41, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 06:01:52,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9bb4fa3917a13dc7c150c99f75727a6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312963"}]},"ts":"1676527312963"} 2023-02-16 06:01:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,965 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-16 06:01:52,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 9bb4fa3917a13dc7c150c99f75727a6e, server=jenkins-hbase4.apache.org,40821,1676527311259 in 226 msec 2023-02-16 06:01:52,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, ASSIGN in 392 msec 2023-02-16 06:01:52,969 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1 2023-02-16 06:01:52,969 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1 2023-02-16 06:01:52,969 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a4e8eda753846f54c0762dcfac76f41 columnFamilyName f1 2023-02-16 06:01:52,970 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(310): Store=9a4e8eda753846f54c0762dcfac76f41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:52,970 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,972 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2 2023-02-16 06:01:52,972 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2 2023-02-16 06:01:52,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,973 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a4e8eda753846f54c0762dcfac76f41 columnFamilyName f2 2023-02-16 06:01:52,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b1ed6fdf8d86e0bcebb6ff768865ccd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74309666, jitterRate=0.10730031132698059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:52,973 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(310): Store=9a4e8eda753846f54c0762dcfac76f41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3., pid=28, masterSystemTime=1676527312904 2023-02-16 06:01:52,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,976 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b1ed6fdf8d86e0bcebb6ff768865ccd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:52,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:52,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:52,976 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527312976"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312976"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312976"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312976"}]},"ts":"1676527312976"} 2023-02-16 06:01:52,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 20b79761eadb9a95a00dc3df218f3676, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 06:01:52,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:52,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,979 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-16 06:01:52,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure b1ed6fdf8d86e0bcebb6ff768865ccd3, server=jenkins-hbase4.apache.org,38609,1676527311236 in 226 msec 2023-02-16 06:01:52,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:52,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, ASSIGN in 403 msec 2023-02-16 06:01:52,985 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1 2023-02-16 06:01:52,985 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1 2023-02-16 06:01:52,985 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b79761eadb9a95a00dc3df218f3676 columnFamilyName f1 2023-02-16 06:01:52,985 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(310): Store=20b79761eadb9a95a00dc3df218f3676/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,986 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,987 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2 2023-02-16 06:01:52,987 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2 2023-02-16 06:01:52,987 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b79761eadb9a95a00dc3df218f3676 columnFamilyName f2 2023-02-16 06:01:52,988 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(310): Store=20b79761eadb9a95a00dc3df218f3676/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:52,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:52,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9a4e8eda753846f54c0762dcfac76f41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64323429, jitterRate=-0.041506215929985046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:52,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:52,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:52,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41., pid=25, masterSystemTime=1676527312892 2023-02-16 06:01:52,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:52,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:52,997 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9a4e8eda753846f54c0762dcfac76f41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:52,997 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527312997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527312997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527312997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527312997"}]},"ts":"1676527312997"} 2023-02-16 06:01:52,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:53,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:53,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 20b79761eadb9a95a00dc3df218f3676; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63507706, jitterRate=-0.05366143584251404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:53,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-16 06:01:53,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 9a4e8eda753846f54c0762dcfac76f41, server=jenkins-hbase4.apache.org,40821,1676527311259 in 260 msec 2023-02-16 06:01:53,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676., pid=29, masterSystemTime=1676527312904 2023-02-16 06:01:53,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, ASSIGN in 430 msec 2023-02-16 06:01:53,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:53,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:53,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=20b79761eadb9a95a00dc3df218f3676, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527313009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527313009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527313009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527313009"}]},"ts":"1676527313009"} 2023-02-16 06:01:53,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-16 06:01:53,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 20b79761eadb9a95a00dc3df218f3676, server=jenkins-hbase4.apache.org,38609,1676527311236 in 257 msec 2023-02-16 06:01:53,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-16 06:01:53,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, ASSIGN in 438 msec 2023-02-16 06:01:53,018 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:53,018 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527313018"}]},"ts":"1676527313018"} 2023-02-16 06:01:53,020 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-16 06:01:53,023 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:53,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 533 msec 2023-02-16 06:01:53,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:01:53,098 INFO [Listener at localhost/44483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-16 06:01:53,098 DEBUG [Listener at localhost/44483] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-16 06:01:53,099 INFO [Listener at localhost/44483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:53,101 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-16 06:01:53,101 INFO [Listener at localhost/44483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:01:53,101 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-16 06:01:53,101 INFO [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:01:53,136 DEBUG [hconnection-0x3ee43e76-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:53,145 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:53,149 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38609] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:53,150 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40821] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:53,212 INFO [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:01:53,212 INFO [Listener at localhost/44483] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:01:53,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 06:01:53,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527313213 (current time:1676527313213). 2023-02-16 06:01:53,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:01:53,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] zookeeper.ReadOnlyZKClient(139): Connect 0x31ba78fe to 127.0.0.1:58053 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:53,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67d3f8ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:53,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:53,224 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31ba78fe to 127.0.0.1:58053 2023-02-16 06:01:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:53,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:01:53,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 06:01:53,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 06:01:53,275 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 06:01:53,275 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676527913275 2023-02-16 06:01:53,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 06:01:53,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,277 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:53,277 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:01:53,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 06:01:53,280 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 06:01:53,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 8 msec 2023-02-16 06:01:53,282 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 06:01:53,283 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676527913283 2023-02-16 06:01:53,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,293 INFO [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 06:01:53,293 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:53,294 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 06:01:53,294 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 06:01:53,294 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,294 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,296 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,296 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:53,296 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:53,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:53,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:53,296 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,296 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,297 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,297 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 06:01:53,298 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 06:01:53,298 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:53,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40821,1676527311259' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 06:01:53,300 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38609,1676527311236' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 06:01:53,301 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,301 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:53,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:53,302 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,302 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,302 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:53,303 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:53,303 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,303 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:53,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:53,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40821,1676527311259' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b24d19[Count = 1] remaining members to acquire global barrier 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:53,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:53,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:53,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:53,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:53,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38609,1676527311236' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 06:01:53,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b24d19[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:53,306 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 06:01:53,306 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:53,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,308 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,308 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:53,308 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:53,308 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. started... 2023-02-16 06:01:53,309 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,309 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:53,309 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:53,309 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. started... 2023-02-16 06:01:53,310 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b6fae2ed95adbc75574581e63dcf26a3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:53,310 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5d54b0efda9e64b101b17c8e82d1673f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:53,310 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 06:01:53,311 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:53,310 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:53,311 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:53,311 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. started... 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. started... 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. started... 2023-02-16 06:01:53,312 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 480c4f6cefd642d467be931fa68dcad8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:53,311 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. started... 2023-02-16 06:01:53,313 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c69fd28608f3217527519596c7dc33a1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:53,313 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:53,313 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9a4e8eda753846f54c0762dcfac76f41 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:53,313 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,314 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,314 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:53,314 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:53,353 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. completed. 2023-02-16 06:01:53,353 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:53,353 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 06:01:53,353 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. started... 2023-02-16 06:01:53,355 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6a2f08b3dd6807aab7d4f64fd2100ddd 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 06:01:53,377 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:53,379 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f1/24200af5d1f548d0b34c7921e977e37f 2023-02-16 06:01:53,380 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f1/2d276dcf7c3c4497b0d27fb34b94f557 2023-02-16 06:01:53,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 06:01:53,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:53,381 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:01:53,384 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f1/0cceb852e25f4ac4aed039568d50f0c2 2023-02-16 06:01:53,407 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f1/bbee8e7fcfd64dcab867a3b187917084 2023-02-16 06:01:53,433 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f2/0b5b8c581cab41fa8b10cd62b7dd19b0 2023-02-16 06:01:53,433 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f2/e5a107a25c9647888854380cfb2c6e28 2023-02-16 06:01:53,436 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f2/dfb8101a03e149eda9da08204f437786 2023-02-16 06:01:53,440 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f1/0cceb852e25f4ac4aed039568d50f0c2 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/0cceb852e25f4ac4aed039568d50f0c2 2023-02-16 06:01:53,441 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f2/f9969fa0e7634b7b832a357a2998a250 2023-02-16 06:01:53,442 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f1/24200af5d1f548d0b34c7921e977e37f as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/24200af5d1f548d0b34c7921e977e37f 2023-02-16 06:01:53,443 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f1/2d276dcf7c3c4497b0d27fb34b94f557 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d276dcf7c3c4497b0d27fb34b94f557 2023-02-16 06:01:53,445 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/0cceb852e25f4ac4aed039568d50f0c2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,446 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f2/e5a107a25c9647888854380cfb2c6e28 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/e5a107a25c9647888854380cfb2c6e28 2023-02-16 06:01:53,447 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f1/bbee8e7fcfd64dcab867a3b187917084 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/bbee8e7fcfd64dcab867a3b187917084 2023-02-16 06:01:53,447 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/24200af5d1f548d0b34c7921e977e37f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,448 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f2/0b5b8c581cab41fa8b10cd62b7dd19b0 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/0b5b8c581cab41fa8b10cd62b7dd19b0 2023-02-16 06:01:53,448 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d276dcf7c3c4497b0d27fb34b94f557, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,449 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f2/dfb8101a03e149eda9da08204f437786 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/dfb8101a03e149eda9da08204f437786 2023-02-16 06:01:53,452 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/bbee8e7fcfd64dcab867a3b187917084, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:53,452 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/e5a107a25c9647888854380cfb2c6e28, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,452 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/0b5b8c581cab41fa8b10cd62b7dd19b0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,453 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f2/f9969fa0e7634b7b832a357a2998a250 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/f9969fa0e7634b7b832a357a2998a250 2023-02-16 06:01:53,453 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c69fd28608f3217527519596c7dc33a1 in 140ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,454 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-16 06:01:53,454 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9a4e8eda753846f54c0762dcfac76f41 in 141ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,454 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-16 06:01:53,455 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/dfb8101a03e149eda9da08204f437786, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,455 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:53,456 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:53,456 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,456 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/24200af5d1f548d0b34c7921e977e37f] hfiles 2023-02-16 06:01:53,457 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b6fae2ed95adbc75574581e63dcf26a3 in 147ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/0cceb852e25f4ac4aed039568d50f0c2] hfiles 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/24200af5d1f548d0b34c7921e977e37f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/0cceb852e25f4ac4aed039568d50f0c2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/0b5b8c581cab41fa8b10cd62b7dd19b0] hfiles 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/e5a107a25c9647888854380cfb2c6e28] hfiles 2023-02-16 06:01:53,457 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/e5a107a25c9647888854380cfb2c6e28 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/0b5b8c581cab41fa8b10cd62b7dd19b0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d276dcf7c3c4497b0d27fb34b94f557] hfiles 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d276dcf7c3c4497b0d27fb34b94f557 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/dfb8101a03e149eda9da08204f437786] hfiles 2023-02-16 06:01:53,458 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/dfb8101a03e149eda9da08204f437786 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,460 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/f9969fa0e7634b7b832a357a2998a250, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:53,461 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6a2f08b3dd6807aab7d4f64fd2100ddd in 106ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/bbee8e7fcfd64dcab867a3b187917084] hfiles 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/bbee8e7fcfd64dcab867a3b187917084 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/f9969fa0e7634b7b832a357a2998a250] hfiles 2023-02-16 06:01:53,461 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/f9969fa0e7634b7b832a357a2998a250 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,464 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. completed. 2023-02-16 06:01:53,464 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:53,464 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:53,464 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 06:01:53,464 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. started... 2023-02-16 06:01:53,465 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. completed. 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 06:01:53,466 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:53,466 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. started... 2023-02-16 06:01:53,467 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 20b79761eadb9a95a00dc3df218f3676 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 06:01:53,470 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. completed. 2023-02-16 06:01:53,470 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:53,470 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 06:01:53,471 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. completed. 2023-02-16 06:01:53,471 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:53,471 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:53,471 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 06:01:53,471 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. started... 2023-02-16 06:01:53,472 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9bb4fa3917a13dc7c150c99f75727a6e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 06:01:53,473 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. completed. 2023-02-16 06:01:53,473 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:53,473 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 06:01:53,481 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f1/512a27a1f1814bad8e34470c3675da8c 2023-02-16 06:01:53,481 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f1/9a1ddcbbe789489385ba206b4ffb47b2 2023-02-16 06:01:53,494 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f2/d18e0f7abe8e42409bc144205701fb20 2023-02-16 06:01:53,495 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f2/6cee3c2ed33c4a5aa27878f6fd85000f 2023-02-16 06:01:53,499 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f1/9a1ddcbbe789489385ba206b4ffb47b2 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/9a1ddcbbe789489385ba206b4ffb47b2 2023-02-16 06:01:53,499 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f1/512a27a1f1814bad8e34470c3675da8c as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/512a27a1f1814bad8e34470c3675da8c 2023-02-16 06:01:53,503 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/9a1ddcbbe789489385ba206b4ffb47b2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:53,503 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f2/d18e0f7abe8e42409bc144205701fb20 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/d18e0f7abe8e42409bc144205701fb20 2023-02-16 06:01:53,504 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/512a27a1f1814bad8e34470c3675da8c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,504 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f2/6cee3c2ed33c4a5aa27878f6fd85000f as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/6cee3c2ed33c4a5aa27878f6fd85000f 2023-02-16 06:01:53,508 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/d18e0f7abe8e42409bc144205701fb20, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 06:01:53,509 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/6cee3c2ed33c4a5aa27878f6fd85000f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,511 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 9bb4fa3917a13dc7c150c99f75727a6e in 39ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/9a1ddcbbe789489385ba206b4ffb47b2] hfiles 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/9a1ddcbbe789489385ba206b4ffb47b2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/d18e0f7abe8e42409bc144205701fb20] hfiles 2023-02-16 06:01:53,511 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/d18e0f7abe8e42409bc144205701fb20 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,512 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 20b79761eadb9a95a00dc3df218f3676 in 44ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/512a27a1f1814bad8e34470c3675da8c] hfiles 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/512a27a1f1814bad8e34470c3675da8c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/6cee3c2ed33c4a5aa27878f6fd85000f] hfiles 2023-02-16 06:01:53,512 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/6cee3c2ed33c4a5aa27878f6fd85000f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,522 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. completed. 2023-02-16 06:01:53,522 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:53,523 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 06:01:53,525 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. completed. 2023-02-16 06:01:53,525 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 06:01:53,581 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:53,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 06:01:53,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:53,582 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 06:01:53,749 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f1/1cd2352789f040a7a4cb1dfe4be2f3d4 2023-02-16 06:01:53,766 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f2/854a25e443b54c5093cf233e74633632 2023-02-16 06:01:53,770 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f1/1cd2352789f040a7a4cb1dfe4be2f3d4 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/1cd2352789f040a7a4cb1dfe4be2f3d4 2023-02-16 06:01:53,774 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/1cd2352789f040a7a4cb1dfe4be2f3d4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,775 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f2/854a25e443b54c5093cf233e74633632 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/854a25e443b54c5093cf233e74633632 2023-02-16 06:01:53,779 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/854a25e443b54c5093cf233e74633632, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,780 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f1/4e78747e5273495eb88dd2f8e9d4162f 2023-02-16 06:01:53,780 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 480c4f6cefd642d467be931fa68dcad8 in 468ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/1cd2352789f040a7a4cb1dfe4be2f3d4] hfiles 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/1cd2352789f040a7a4cb1dfe4be2f3d4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/854a25e443b54c5093cf233e74633632] hfiles 2023-02-16 06:01:53,781 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/854a25e443b54c5093cf233e74633632 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,787 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. completed. 2023-02-16 06:01:53,787 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:53,787 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 06:01:53,787 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 06:01:53,787 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,787 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 06:01:53,787 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38609,1676527311236' in zk 2023-02-16 06:01:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 06:01:53,789 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:53,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:53,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 06:01:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:53,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38609,1676527311236': 2023-02-16 06:01:53,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38609,1676527311236' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 06:01:53,794 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f2/59107092a7ec466ab949579a76043f93 2023-02-16 06:01:53,799 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f1/4e78747e5273495eb88dd2f8e9d4162f as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/4e78747e5273495eb88dd2f8e9d4162f 2023-02-16 06:01:53,803 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/4e78747e5273495eb88dd2f8e9d4162f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,803 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f2/59107092a7ec466ab949579a76043f93 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/59107092a7ec466ab949579a76043f93 2023-02-16 06:01:53,806 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/59107092a7ec466ab949579a76043f93, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 06:01:53,807 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5d54b0efda9e64b101b17c8e82d1673f in 497ms, sequenceid=5, compaction requested=false 2023-02-16 06:01:53,807 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:53,807 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,808 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:01:53,808 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/4e78747e5273495eb88dd2f8e9d4162f] hfiles 2023-02-16 06:01:53,808 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/4e78747e5273495eb88dd2f8e9d4162f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,808 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/59107092a7ec466ab949579a76043f93] hfiles 2023-02-16 06:01:53,808 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/59107092a7ec466ab949579a76043f93 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,813 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. completed. 2023-02-16 06:01:53,813 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 06:01:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 06:01:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 06:01:53,813 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40821,1676527311259' in zk 2023-02-16 06:01:53,816 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 06:01:53,816 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,816 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:53,816 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 06:01:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40821,1676527311259': 2023-02-16 06:01:53,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40821,1676527311259' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 06:01:53,819 INFO [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 06:01:53,819 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:53,819 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:53,819 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,819 INFO [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:01:53,822 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:53,822 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:01:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:53,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:53,822 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,823 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,824 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,824 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,830 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:53,830 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:01:53,830 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:53,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:53,830 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:01:53,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:01:53,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,830 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:53,831 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:53,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:01:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:53,831 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:53,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,883 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:53,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 06:01:53,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:01:53,884 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 06:01:53,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-16 06:01:53,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,885 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:53,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676527313276Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676527313831 (+555 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676527313831Writing data manifest for testWithMockedMapReduceMultiRegion at 1676527313839 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676527313849 (+10 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676527313885 (+36 ms) 2023-02-16 06:01:53,888 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 06:01:53,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 612 msec 2023-02-16 06:01:54,385 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:01:54,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 06:01:54,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:01:54,386 INFO [Listener at localhost/44483] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:01:54,390 INFO [Listener at localhost/44483] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:01:54,396 INFO [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:01:54,418 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40821] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:54,420 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38609] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:54,479 INFO [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:01:54,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:01:54,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,488 INFO [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 06:01:54,488 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:54,489 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 06:01:54,489 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 06:01:54,489 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,489 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,536 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:54,536 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:54,536 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:54,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:54,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:54,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:54,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:54,536 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:54,536 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:54,537 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,537 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,538 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 06:01:54,538 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 06:01:54,538 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:54,538 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:01:54,539 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 06:01:54,540 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. started... 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. started... 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. started... 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:54,540 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 480c4f6cefd642d467be931fa68dcad8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:54,540 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:54,540 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6fae2ed95adbc75574581e63dcf26a3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:54,544 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:54,545 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. started... 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:54,545 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 06:01:54,545 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. started... 2023-02-16 06:01:54,545 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5d54b0efda9e64b101b17c8e82d1673f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. started... 2023-02-16 06:01:54,545 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6a2f08b3dd6807aab7d4f64fd2100ddd 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 06:01:54,545 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9a4e8eda753846f54c0762dcfac76f41 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:54,545 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. started... 2023-02-16 06:01:54,546 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c69fd28608f3217527519596c7dc33a1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:54,545 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:01:54,545 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 06:01:54,561 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f1/e59fbf48745149edaa459c9191a5fa8d 2023-02-16 06:01:54,562 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f1/dbd3081562fc471f8b014a9bfb17067a 2023-02-16 06:01:54,563 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f1/641ee546069b48658d5e3092d30bce56 2023-02-16 06:01:54,564 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f1/2d9b4a6caf5544c885331be2464f64e0 2023-02-16 06:01:54,564 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f1/ccf04f4dfde84cb681e01e3c9506de6a 2023-02-16 06:01:54,565 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f1/2dffa86840fd43e3818448b2bc809d0d 2023-02-16 06:01:54,601 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f2/d4f9747952314f6fb53a91f5a08b85f2 2023-02-16 06:01:54,612 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f2/1b23249fb69a4b9fad13ca0f52894846 2023-02-16 06:01:54,615 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f1/2d9b4a6caf5544c885331be2464f64e0 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d9b4a6caf5544c885331be2464f64e0 2023-02-16 06:01:54,615 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f2/2d5a958eec4b465c959ba5f24fc4100e 2023-02-16 06:01:54,620 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f2/eb61ebfd76fc45f68ef6b08063ac0b4e 2023-02-16 06:01:54,621 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f1/e59fbf48745149edaa459c9191a5fa8d as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/e59fbf48745149edaa459c9191a5fa8d 2023-02-16 06:01:54,623 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d9b4a6caf5544c885331be2464f64e0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,624 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/.tmp/f2/d4f9747952314f6fb53a91f5a08b85f2 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/d4f9747952314f6fb53a91f5a08b85f2 2023-02-16 06:01:54,626 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f1/2dffa86840fd43e3818448b2bc809d0d as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/2dffa86840fd43e3818448b2bc809d0d 2023-02-16 06:01:54,629 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/e59fbf48745149edaa459c9191a5fa8d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,631 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/d4f9747952314f6fb53a91f5a08b85f2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,631 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/.tmp/f2/1b23249fb69a4b9fad13ca0f52894846 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/1b23249fb69a4b9fad13ca0f52894846 2023-02-16 06:01:54,632 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b6fae2ed95adbc75574581e63dcf26a3 in 91ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:54,632 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/2dffa86840fd43e3818448b2bc809d0d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:54,632 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. started... 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f1/ccf04f4dfde84cb681e01e3c9506de6a as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/ccf04f4dfde84cb681e01e3c9506de6a 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:54,632 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 06:01:54,632 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:54,633 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. started... 2023-02-16 06:01:54,633 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9bb4fa3917a13dc7c150c99f75727a6e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 06:01:54,633 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/.tmp/f2/2d5a958eec4b465c959ba5f24fc4100e as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/2d5a958eec4b465c959ba5f24fc4100e 2023-02-16 06:01:54,636 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f2/4ff9deaf810840f48d20ba6795e89899 2023-02-16 06:01:54,639 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/1b23249fb69a4b9fad13ca0f52894846, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,639 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/2d5a958eec4b465c959ba5f24fc4100e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:54,639 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c69fd28608f3217527519596c7dc33a1 in 93ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,639 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:54,639 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:54,639 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6a2f08b3dd6807aab7d4f64fd2100ddd in 94ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,640 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:54,640 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:54,640 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:54,640 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. started... 2023-02-16 06:01:54,640 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 20b79761eadb9a95a00dc3df218f3676 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 06:01:54,640 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 06:01:54,640 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 06:01:54,641 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f1/641ee546069b48658d5e3092d30bce56 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/641ee546069b48658d5e3092d30bce56 2023-02-16 06:01:54,646 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/ccf04f4dfde84cb681e01e3c9506de6a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,647 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/.tmp/f2/eb61ebfd76fc45f68ef6b08063ac0b4e as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/eb61ebfd76fc45f68ef6b08063ac0b4e 2023-02-16 06:01:54,650 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/641ee546069b48658d5e3092d30bce56, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,650 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/.tmp/f2/4ff9deaf810840f48d20ba6795e89899 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/4ff9deaf810840f48d20ba6795e89899 2023-02-16 06:01:54,658 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/eb61ebfd76fc45f68ef6b08063ac0b4e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,659 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 480c4f6cefd642d467be931fa68dcad8 in 119ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,659 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:54,659 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:54,659 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 06:01:54,660 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/4ff9deaf810840f48d20ba6795e89899, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,661 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5d54b0efda9e64b101b17c8e82d1673f in 116ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,661 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:54,661 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:54,661 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 06:01:54,676 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f1/39a7a512e5484970b66fe3ce3dd1bc16 2023-02-16 06:01:54,688 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f1/0978bd0a037d4da38a4c04293dbdbfa3 2023-02-16 06:01:54,695 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f2/e214e94d970b44ab82fa589068207ae9 2023-02-16 06:01:54,699 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f1/39a7a512e5484970b66fe3ce3dd1bc16 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/39a7a512e5484970b66fe3ce3dd1bc16 2023-02-16 06:01:54,702 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f2/044b30dd4f5944839e3c3ce0651612ea 2023-02-16 06:01:54,703 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/39a7a512e5484970b66fe3ce3dd1bc16, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:54,703 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/.tmp/f2/e214e94d970b44ab82fa589068207ae9 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/e214e94d970b44ab82fa589068207ae9 2023-02-16 06:01:54,706 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f1/0978bd0a037d4da38a4c04293dbdbfa3 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/0978bd0a037d4da38a4c04293dbdbfa3 2023-02-16 06:01:54,708 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/e214e94d970b44ab82fa589068207ae9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 06:01:54,709 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 9bb4fa3917a13dc7c150c99f75727a6e in 76ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,709 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:54,709 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:54,709 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 06:01:54,711 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/0978bd0a037d4da38a4c04293dbdbfa3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,711 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/.tmp/f2/044b30dd4f5944839e3c3ce0651612ea as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/044b30dd4f5944839e3c3ce0651612ea 2023-02-16 06:01:54,715 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/044b30dd4f5944839e3c3ce0651612ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:54,716 INFO [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 20b79761eadb9a95a00dc3df218f3676 in 76ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:54,716 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:54,716 DEBUG [rs(jenkins-hbase4.apache.org,38609,1676527311236)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:54,716 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 06:01:54,716 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 06:01:54,716 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:54,716 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 06:01:54,716 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38609,1676527311236' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 06:01:54,806 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:54,806 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:54,807 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:54,807 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38609,1676527311236' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 06:01:54,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@228dcd17[Count = 1] remaining members to acquire global barrier 2023-02-16 06:01:55,015 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f2/96a3e5e10e6a41a4bd2e69488bb8261b 2023-02-16 06:01:55,020 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f1/dbd3081562fc471f8b014a9bfb17067a as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/dbd3081562fc471f8b014a9bfb17067a 2023-02-16 06:01:55,024 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/dbd3081562fc471f8b014a9bfb17067a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:55,025 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/.tmp/f2/96a3e5e10e6a41a4bd2e69488bb8261b as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/96a3e5e10e6a41a4bd2e69488bb8261b 2023-02-16 06:01:55,029 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/96a3e5e10e6a41a4bd2e69488bb8261b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 06:01:55,030 INFO [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9a4e8eda753846f54c0762dcfac76f41 in 485ms, sequenceid=9, compaction requested=false 2023-02-16 06:01:55,030 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:55,030 DEBUG [rs(jenkins-hbase4.apache.org,40821,1676527311259)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:55,030 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 06:01:55,030 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 06:01:55,030 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,030 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 06:01:55,030 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40821,1676527311259' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 06:01:55,090 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,090 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:55,091 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,091 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:01:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:55,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40821,1676527311259' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 06:01:55,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@228dcd17[Count = 0] remaining members to acquire global barrier 2023-02-16 06:01:55,092 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 06:01:55,092 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,129 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:55,129 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 06:01:55,129 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 06:01:55,129 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 06:01:55,129 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38609,1676527311236' in zk 2023-02-16 06:01:55,129 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,129 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40821,1676527311259' in zk 2023-02-16 06:01:55,130 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,130 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 06:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 06:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:55,182 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,38609,1676527311236' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 06:01:55,182 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:55,182 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,40821,1676527311259' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 06:01:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40821,1676527311259': 2023-02-16 06:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40821,1676527311259' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 06:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:55,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38609,1676527311236': 2023-02-16 06:01:55,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38609,1676527311236' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 06:01:55,192 INFO [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 06:01:55,192 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:01:55,192 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:01:55,192 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,192 INFO [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:01:55,236 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:01:55,236 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:55,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,236 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:55,237 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,237 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:01:55,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,239 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:01:55,239 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,282 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,282 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:55,282 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:55,282 DEBUG [(jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:01:55,282 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:01:55,282 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-16 06:01:55,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:01:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:55,282 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,282 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-16 06:01:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:01:55,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,283 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:55,284 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:01:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:55,284 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,383 DEBUG [Listener at localhost/44483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:01:55,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:01:55,389 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676527313213 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:55,390 DEBUG [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:55,390 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(239): region to add: 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=b6fae2ed95adbc75574581e63dcf26a3 as b6fae2ed95adbc75574581e63dcf26a3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=b1ed6fdf8d86e0bcebb6ff768865ccd3 as b1ed6fdf8d86e0bcebb6ff768865ccd3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=5d54b0efda9e64b101b17c8e82d1673f as 5d54b0efda9e64b101b17c8e82d1673f in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=9a4e8eda753846f54c0762dcfac76f41 as 9a4e8eda753846f54c0762dcfac76f41 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=480c4f6cefd642d467be931fa68dcad8 as 480c4f6cefd642d467be931fa68dcad8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=c69fd28608f3217527519596c7dc33a1 as c69fd28608f3217527519596c7dc33a1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=6a2f08b3dd6807aab7d4f64fd2100ddd as 6a2f08b3dd6807aab7d4f64fd2100ddd in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=20b79761eadb9a95a00dc3df218f3676 as 20b79761eadb9a95a00dc3df218f3676 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=1ff9d03457dfa285ee7d71a79a2ec688 as 1ff9d03457dfa285ee7d71a79a2ec688 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,391 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(585): clone region=9bb4fa3917a13dc7c150c99f75727a6e as 9bb4fa3917a13dc7c150c99f75727a6e in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,392 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c69fd28608f3217527519596c7dc33a1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,392 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 480c4f6cefd642d467be931fa68dcad8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,393 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9a4e8eda753846f54c0762dcfac76f41, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,393 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5d54b0efda9e64b101b17c8e82d1673f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,393 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => b1ed6fdf8d86e0bcebb6ff768865ccd3, NAME => 'testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,393 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 6a2f08b3dd6807aab7d4f64fd2100ddd, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,393 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b6fae2ed95adbc75574581e63dcf26a3, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,400 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 20b79761eadb9a95a00dc3df218f3676, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,408 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,408 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,409 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4e78747e5273495eb88dd2f8e9d4162f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,409 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing b1ed6fdf8d86e0bcebb6ff768865ccd3, disabling compactions & flushes 2023-02-16 06:01:55,409 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:55,409 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:55,409 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. after waiting 0 ms 2023-02-16 06:01:55,409 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:55,409 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:55,409 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:55,409 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1ff9d03457dfa285ee7d71a79a2ec688, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,410 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,410 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbee8e7fcfd64dcab867a3b187917084 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,411 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,411 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0cceb852e25f4ac4aed039568d50f0c2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,412 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59107092a7ec466ab949579a76043f93 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,413 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,413 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1cd2352789f040a7a4cb1dfe4be2f3d4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,418 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,418 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 24200af5d1f548d0b34c7921e977e37f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,418 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9969fa0e7634b7b832a357a2998a250 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,419 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,419 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 512a27a1f1814bad8e34470c3675da8c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,420 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 854a25e443b54c5093cf233e74633632 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,420 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5a107a25c9647888854380cfb2c6e28 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,421 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 5d54b0efda9e64b101b17c8e82d1673f, disabling compactions & flushes 2023-02-16 06:01:55,421 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:55,421 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:55,421 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. after waiting 0 ms 2023-02-16 06:01:55,421 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:55,421 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:55,421 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:55,422 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9bb4fa3917a13dc7c150c99f75727a6e, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,433 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 480c4f6cefd642d467be931fa68dcad8, disabling compactions & flushes 2023-02-16 06:01:55,433 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:55,433 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:55,433 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. after waiting 0 ms 2023-02-16 06:01:55,433 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:55,433 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:55,433 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9a4e8eda753846f54c0762dcfac76f41, disabling compactions & flushes 2023-02-16 06:01:55,434 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. after waiting 0 ms 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:55,434 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:55,434 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b5b8c581cab41fa8b10cd62b7dd19b0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 1ff9d03457dfa285ee7d71a79a2ec688, disabling compactions & flushes 2023-02-16 06:01:55,434 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:55,434 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. after waiting 0 ms 2023-02-16 06:01:55,435 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:55,435 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:55,435 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:55,435 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6cee3c2ed33c4a5aa27878f6fd85000f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,436 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 6a2f08b3dd6807aab7d4f64fd2100ddd, disabling compactions & flushes 2023-02-16 06:01:55,436 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:55,436 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:55,436 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. after waiting 0 ms 2023-02-16 06:01:55,436 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:55,436 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:55,436 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c69fd28608f3217527519596c7dc33a1, disabling compactions & flushes 2023-02-16 06:01:55,437 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. after waiting 0 ms 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:55,437 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 20b79761eadb9a95a00dc3df218f3676, disabling compactions & flushes 2023-02-16 06:01:55,437 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. after waiting 0 ms 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:55,437 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:55,437 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:55,439 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,439 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a1ddcbbe789489385ba206b4ffb47b2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,440 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d18e0f7abe8e42409bc144205701fb20 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,442 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 9bb4fa3917a13dc7c150c99f75727a6e, disabling compactions & flushes 2023-02-16 06:01:55,442 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:55,442 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:55,442 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. after waiting 0 ms 2023-02-16 06:01:55,442 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:55,442 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:55,442 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:55,810 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:55,811 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2d276dcf7c3c4497b0d27fb34b94f557 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,813 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dfb8101a03e149eda9da08204f437786 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:55,814 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b6fae2ed95adbc75574581e63dcf26a3, disabling compactions & flushes 2023-02-16 06:01:55,814 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:55,814 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:55,814 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. after waiting 0 ms 2023-02-16 06:01:55,814 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:55,814 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:55,815 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:55,815 INFO [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676527313213 type: FLUSH version: 2 ttl: 0 2023-02-16 06:01:55,815 DEBUG [Listener at localhost/44483] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,815 DEBUG [Listener at localhost/44483] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a 2023-02-16 06:01:55,815 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-data/ 2023-02-16 06:01:55,816 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----default/ 2023-02-16 06:01:55,816 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-16 06:01:55,817 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------1ff9d03457dfa285ee7d71a79a2ec688/ 2023-02-16 06:01:55,817 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,817 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------20b79761eadb9a95a00dc3df218f3676/ 2023-02-16 06:01:55,817 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,817 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,818 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=20b79761eadb9a95a00dc3df218f3676-512a27a1f1814bad8e34470c3675da8c 2023-02-16 06:01:55,818 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,818 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=20b79761eadb9a95a00dc3df218f3676-6cee3c2ed33c4a5aa27878f6fd85000f 2023-02-16 06:01:55,818 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------480c4f6cefd642d467be931fa68dcad8/ 2023-02-16 06:01:55,818 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,818 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,819 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=480c4f6cefd642d467be931fa68dcad8-1cd2352789f040a7a4cb1dfe4be2f3d4 2023-02-16 06:01:55,819 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,819 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=480c4f6cefd642d467be931fa68dcad8-854a25e443b54c5093cf233e74633632 2023-02-16 06:01:55,819 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------5d54b0efda9e64b101b17c8e82d1673f/ 2023-02-16 06:01:55,819 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,819 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,820 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5d54b0efda9e64b101b17c8e82d1673f-4e78747e5273495eb88dd2f8e9d4162f 2023-02-16 06:01:55,820 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,820 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5d54b0efda9e64b101b17c8e82d1673f-59107092a7ec466ab949579a76043f93 2023-02-16 06:01:55,820 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------6a2f08b3dd6807aab7d4f64fd2100ddd/ 2023-02-16 06:01:55,820 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,820 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,821 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6a2f08b3dd6807aab7d4f64fd2100ddd-bbee8e7fcfd64dcab867a3b187917084 2023-02-16 06:01:55,821 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,821 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6a2f08b3dd6807aab7d4f64fd2100ddd-f9969fa0e7634b7b832a357a2998a250 2023-02-16 06:01:55,821 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------9a4e8eda753846f54c0762dcfac76f41/ 2023-02-16 06:01:55,821 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,821 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,822 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9a4e8eda753846f54c0762dcfac76f41-0cceb852e25f4ac4aed039568d50f0c2 2023-02-16 06:01:55,822 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,822 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9a4e8eda753846f54c0762dcfac76f41-e5a107a25c9647888854380cfb2c6e28 2023-02-16 06:01:55,822 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------9bb4fa3917a13dc7c150c99f75727a6e/ 2023-02-16 06:01:55,822 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,822 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,823 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9bb4fa3917a13dc7c150c99f75727a6e-9a1ddcbbe789489385ba206b4ffb47b2 2023-02-16 06:01:55,823 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,823 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9bb4fa3917a13dc7c150c99f75727a6e-d18e0f7abe8e42409bc144205701fb20 2023-02-16 06:01:55,823 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------b1ed6fdf8d86e0bcebb6ff768865ccd3/ 2023-02-16 06:01:55,823 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,823 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------b6fae2ed95adbc75574581e63dcf26a3/ 2023-02-16 06:01:55,824 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,824 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,824 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b6fae2ed95adbc75574581e63dcf26a3-2d276dcf7c3c4497b0d27fb34b94f557 2023-02-16 06:01:55,824 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,824 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b6fae2ed95adbc75574581e63dcf26a3-dfb8101a03e149eda9da08204f437786 2023-02-16 06:01:55,824 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |----------c69fd28608f3217527519596c7dc33a1/ 2023-02-16 06:01:55,825 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:01:55,825 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:01:55,825 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c69fd28608f3217527519596c7dc33a1-24200af5d1f548d0b34c7921e977e37f 2023-02-16 06:01:55,825 DEBUG [Listener at localhost/44483] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:01:55,825 DEBUG [Listener at localhost/44483] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c69fd28608f3217527519596c7dc33a1-0b5b8c581cab41fa8b10cd62b7dd19b0 2023-02-16 06:01:55,828 INFO [Listener at localhost/44483] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 06:01:56,489 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,489 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,492 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,494 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:56,495 DEBUG [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f1 2023-02-16 06:01:56,496 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff9d03457dfa285ee7d71a79a2ec688 columnFamilyName f1 2023-02-16 06:01:56,496 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(310): Store=1ff9d03457dfa285ee7d71a79a2ec688/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,496 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:56,497 DEBUG [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f2 2023-02-16 06:01:56,497 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff9d03457dfa285ee7d71a79a2ec688 columnFamilyName f2 2023-02-16 06:01:56,498 INFO [StoreOpener-1ff9d03457dfa285ee7d71a79a2ec688-1] regionserver.HStore(310): Store=1ff9d03457dfa285ee7d71a79a2ec688/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,498 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,498 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 1ff9d03457dfa285ee7d71a79a2ec688; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65090406, jitterRate=-0.030077368021011353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,498 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:56,498 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 1ff9d03457dfa285ee7d71a79a2ec688, disabling compactions & flushes 2023-02-16 06:01:56,498 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,498 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,498 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. after waiting 0 ms 2023-02-16 06:01:56,499 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,499 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,499 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:56,499 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,499 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,501 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,502 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:56,503 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1 2023-02-16 06:01:56,503 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f08b3dd6807aab7d4f64fd2100ddd columnFamilyName f1 2023-02-16 06:01:56,516 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/testWithMockedMapReduceMultiRegion=6a2f08b3dd6807aab7d4f64fd2100ddd-bbee8e7fcfd64dcab867a3b187917084 2023-02-16 06:01:56,516 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(310): Store=6a2f08b3dd6807aab7d4f64fd2100ddd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,516 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:56,517 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2 2023-02-16 06:01:56,518 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2f08b3dd6807aab7d4f64fd2100ddd columnFamilyName f2 2023-02-16 06:01:56,524 DEBUG [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/testWithMockedMapReduceMultiRegion=6a2f08b3dd6807aab7d4f64fd2100ddd-f9969fa0e7634b7b832a357a2998a250 2023-02-16 06:01:56,524 INFO [StoreOpener-6a2f08b3dd6807aab7d4f64fd2100ddd-1] regionserver.HStore(310): Store=6a2f08b3dd6807aab7d4f64fd2100ddd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,528 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,528 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 6a2f08b3dd6807aab7d4f64fd2100ddd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67579237, jitterRate=0.007009103894233704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,528 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:56,542 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 6a2f08b3dd6807aab7d4f64fd2100ddd, disabling compactions & flushes 2023-02-16 06:01:56,542 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:56,542 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:56,542 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. after waiting 0 ms 2023-02-16 06:01:56,542 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:56,545 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:56,545 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:56,546 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,546 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,552 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,557 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:56,558 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1 2023-02-16 06:01:56,558 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c69fd28608f3217527519596c7dc33a1 columnFamilyName f1 2023-02-16 06:01:56,563 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/testWithMockedMapReduceMultiRegion=c69fd28608f3217527519596c7dc33a1-24200af5d1f548d0b34c7921e977e37f 2023-02-16 06:01:56,563 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(310): Store=c69fd28608f3217527519596c7dc33a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,563 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:56,564 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2 2023-02-16 06:01:56,564 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c69fd28608f3217527519596c7dc33a1 columnFamilyName f2 2023-02-16 06:01:56,568 DEBUG [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/testWithMockedMapReduceMultiRegion=c69fd28608f3217527519596c7dc33a1-0b5b8c581cab41fa8b10cd62b7dd19b0 2023-02-16 06:01:56,568 INFO [StoreOpener-c69fd28608f3217527519596c7dc33a1-1] regionserver.HStore(310): Store=c69fd28608f3217527519596c7dc33a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,568 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,568 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened c69fd28608f3217527519596c7dc33a1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62287126, jitterRate=-0.07184949517250061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,568 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:56,577 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing c69fd28608f3217527519596c7dc33a1, disabling compactions & flushes 2023-02-16 06:01:56,578 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,578 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,578 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. after waiting 0 ms 2023-02-16 06:01:56,578 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,579 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,579 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:56,579 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,580 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,581 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,583 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:56,584 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1 2023-02-16 06:01:56,584 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d54b0efda9e64b101b17c8e82d1673f columnFamilyName f1 2023-02-16 06:01:56,588 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/testWithMockedMapReduceMultiRegion=5d54b0efda9e64b101b17c8e82d1673f-4e78747e5273495eb88dd2f8e9d4162f 2023-02-16 06:01:56,588 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(310): Store=5d54b0efda9e64b101b17c8e82d1673f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,588 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:56,589 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2 2023-02-16 06:01:56,590 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d54b0efda9e64b101b17c8e82d1673f columnFamilyName f2 2023-02-16 06:01:56,597 DEBUG [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/testWithMockedMapReduceMultiRegion=5d54b0efda9e64b101b17c8e82d1673f-59107092a7ec466ab949579a76043f93 2023-02-16 06:01:56,597 INFO [StoreOpener-5d54b0efda9e64b101b17c8e82d1673f-1] regionserver.HStore(310): Store=5d54b0efda9e64b101b17c8e82d1673f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,597 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,598 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 5d54b0efda9e64b101b17c8e82d1673f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66797448, jitterRate=-0.004640460014343262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,598 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:56,606 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 5d54b0efda9e64b101b17c8e82d1673f, disabling compactions & flushes 2023-02-16 06:01:56,607 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,607 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,607 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. after waiting 0 ms 2023-02-16 06:01:56,607 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,608 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,608 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:56,608 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,609 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,610 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,612 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:56,613 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1 2023-02-16 06:01:56,613 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a4e8eda753846f54c0762dcfac76f41 columnFamilyName f1 2023-02-16 06:01:56,617 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/testWithMockedMapReduceMultiRegion=9a4e8eda753846f54c0762dcfac76f41-0cceb852e25f4ac4aed039568d50f0c2 2023-02-16 06:01:56,617 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(310): Store=9a4e8eda753846f54c0762dcfac76f41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,618 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:56,618 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2 2023-02-16 06:01:56,619 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a4e8eda753846f54c0762dcfac76f41 columnFamilyName f2 2023-02-16 06:01:56,625 DEBUG [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/testWithMockedMapReduceMultiRegion=9a4e8eda753846f54c0762dcfac76f41-e5a107a25c9647888854380cfb2c6e28 2023-02-16 06:01:56,625 INFO [StoreOpener-9a4e8eda753846f54c0762dcfac76f41-1] regionserver.HStore(310): Store=9a4e8eda753846f54c0762dcfac76f41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,626 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,626 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 9a4e8eda753846f54c0762dcfac76f41; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59372249, jitterRate=-0.11528454720973969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,626 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:56,638 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 9a4e8eda753846f54c0762dcfac76f41, disabling compactions & flushes 2023-02-16 06:01:56,638 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,639 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,639 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. after waiting 0 ms 2023-02-16 06:01:56,639 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,644 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,644 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:56,645 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,645 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,651 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,661 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:56,662 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1 2023-02-16 06:01:56,663 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 480c4f6cefd642d467be931fa68dcad8 columnFamilyName f1 2023-02-16 06:01:56,668 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/testWithMockedMapReduceMultiRegion=480c4f6cefd642d467be931fa68dcad8-1cd2352789f040a7a4cb1dfe4be2f3d4 2023-02-16 06:01:56,669 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(310): Store=480c4f6cefd642d467be931fa68dcad8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,669 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:56,670 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2 2023-02-16 06:01:56,670 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 480c4f6cefd642d467be931fa68dcad8 columnFamilyName f2 2023-02-16 06:01:56,674 DEBUG [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/testWithMockedMapReduceMultiRegion=480c4f6cefd642d467be931fa68dcad8-854a25e443b54c5093cf233e74633632 2023-02-16 06:01:56,675 INFO [StoreOpener-480c4f6cefd642d467be931fa68dcad8-1] regionserver.HStore(310): Store=480c4f6cefd642d467be931fa68dcad8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,675 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,675 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 480c4f6cefd642d467be931fa68dcad8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71382647, jitterRate=0.06368432939052582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,675 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:56,684 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 480c4f6cefd642d467be931fa68dcad8, disabling compactions & flushes 2023-02-16 06:01:56,684 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,684 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,684 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. after waiting 0 ms 2023-02-16 06:01:56,684 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,685 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,685 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:56,686 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,686 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,689 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,691 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:56,692 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1 2023-02-16 06:01:56,692 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6fae2ed95adbc75574581e63dcf26a3 columnFamilyName f1 2023-02-16 06:01:56,697 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/testWithMockedMapReduceMultiRegion=b6fae2ed95adbc75574581e63dcf26a3-2d276dcf7c3c4497b0d27fb34b94f557 2023-02-16 06:01:56,697 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(310): Store=b6fae2ed95adbc75574581e63dcf26a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,698 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:56,698 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2 2023-02-16 06:01:56,699 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6fae2ed95adbc75574581e63dcf26a3 columnFamilyName f2 2023-02-16 06:01:56,702 DEBUG [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/testWithMockedMapReduceMultiRegion=b6fae2ed95adbc75574581e63dcf26a3-dfb8101a03e149eda9da08204f437786 2023-02-16 06:01:56,703 INFO [StoreOpener-b6fae2ed95adbc75574581e63dcf26a3-1] regionserver.HStore(310): Store=b6fae2ed95adbc75574581e63dcf26a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,703 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,703 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened b6fae2ed95adbc75574581e63dcf26a3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73196787, jitterRate=0.0907171219587326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,703 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:56,714 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing b6fae2ed95adbc75574581e63dcf26a3, disabling compactions & flushes 2023-02-16 06:01:56,715 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:56,715 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:56,715 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. after waiting 0 ms 2023-02-16 06:01:56,715 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:56,716 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:56,716 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:56,716 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,717 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,718 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,720 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:56,721 DEBUG [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f1 2023-02-16 06:01:56,721 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1ed6fdf8d86e0bcebb6ff768865ccd3 columnFamilyName f1 2023-02-16 06:01:56,722 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(310): Store=b1ed6fdf8d86e0bcebb6ff768865ccd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,722 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:56,723 DEBUG [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f2 2023-02-16 06:01:56,723 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1ed6fdf8d86e0bcebb6ff768865ccd3 columnFamilyName f2 2023-02-16 06:01:56,723 INFO [StoreOpener-b1ed6fdf8d86e0bcebb6ff768865ccd3-1] regionserver.HStore(310): Store=b1ed6fdf8d86e0bcebb6ff768865ccd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,724 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,724 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened b1ed6fdf8d86e0bcebb6ff768865ccd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66275137, jitterRate=-0.012423500418663025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,724 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:56,724 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing b1ed6fdf8d86e0bcebb6ff768865ccd3, disabling compactions & flushes 2023-02-16 06:01:56,724 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:56,724 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:56,724 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. after waiting 0 ms 2023-02-16 06:01:56,724 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:56,724 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:56,725 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:56,725 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,725 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,726 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,728 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:56,729 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1 2023-02-16 06:01:56,729 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bb4fa3917a13dc7c150c99f75727a6e columnFamilyName f1 2023-02-16 06:01:56,733 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/testWithMockedMapReduceMultiRegion=9bb4fa3917a13dc7c150c99f75727a6e-9a1ddcbbe789489385ba206b4ffb47b2 2023-02-16 06:01:56,733 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(310): Store=9bb4fa3917a13dc7c150c99f75727a6e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,733 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:56,734 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2 2023-02-16 06:01:56,734 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bb4fa3917a13dc7c150c99f75727a6e columnFamilyName f2 2023-02-16 06:01:56,737 DEBUG [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/testWithMockedMapReduceMultiRegion=9bb4fa3917a13dc7c150c99f75727a6e-d18e0f7abe8e42409bc144205701fb20 2023-02-16 06:01:56,737 INFO [StoreOpener-9bb4fa3917a13dc7c150c99f75727a6e-1] regionserver.HStore(310): Store=9bb4fa3917a13dc7c150c99f75727a6e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,738 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,738 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 9bb4fa3917a13dc7c150c99f75727a6e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68876140, jitterRate=0.02633446455001831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,738 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:56,749 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 9bb4fa3917a13dc7c150c99f75727a6e, disabling compactions & flushes 2023-02-16 06:01:56,749 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:56,749 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:56,749 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. after waiting 0 ms 2023-02-16 06:01:56,749 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:56,750 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:56,750 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:56,751 DEBUG [Listener at localhost/44483] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:56,751 INFO [Listener at localhost/44483] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:01:56,753 DEBUG [Listener at localhost/44483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:56,755 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:56,756 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1 2023-02-16 06:01:56,756 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b79761eadb9a95a00dc3df218f3676 columnFamilyName f1 2023-02-16 06:01:56,760 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/testWithMockedMapReduceMultiRegion=20b79761eadb9a95a00dc3df218f3676-512a27a1f1814bad8e34470c3675da8c 2023-02-16 06:01:56,761 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(310): Store=20b79761eadb9a95a00dc3df218f3676/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,761 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:56,762 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2 2023-02-16 06:01:56,762 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b79761eadb9a95a00dc3df218f3676 columnFamilyName f2 2023-02-16 06:01:56,766 DEBUG [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(539): loaded hdfs://localhost:35921/user/jenkins/test-data/c435af1b-7d48-fccf-8ca6-52973acd646b/testWithMockedMapReduceMultiRegion/d605c372-ef0f-4d57-ab0b-32fd05c6585a/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/testWithMockedMapReduceMultiRegion=20b79761eadb9a95a00dc3df218f3676-6cee3c2ed33c4a5aa27878f6fd85000f 2023-02-16 06:01:56,766 INFO [StoreOpener-20b79761eadb9a95a00dc3df218f3676-1] regionserver.HStore(310): Store=20b79761eadb9a95a00dc3df218f3676/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:56,767 DEBUG [Listener at localhost/44483] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:01:56,767 INFO [Listener at localhost/44483] regionserver.HRegion(1071): Opened 20b79761eadb9a95a00dc3df218f3676; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69601711, jitterRate=0.03714631497859955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:01:56,767 DEBUG [Listener at localhost/44483] regionserver.HRegion(964): Region open journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:56,779 DEBUG [Listener at localhost/44483] regionserver.HRegion(1603): Closing 20b79761eadb9a95a00dc3df218f3676, disabling compactions & flushes 2023-02-16 06:01:56,779 INFO [Listener at localhost/44483] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,780 DEBUG [Listener at localhost/44483] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,780 DEBUG [Listener at localhost/44483] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. after waiting 0 ms 2023-02-16 06:01:56,780 DEBUG [Listener at localhost/44483] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,781 INFO [Listener at localhost/44483] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,781 DEBUG [Listener at localhost/44483] regionserver.HRegion(1557): Region close journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:56,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-16 06:01:56,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-16 06:01:56,792 INFO [Listener at localhost/44483] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 06:01:56,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 06:01:56,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:56,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:56,800 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527316800"}]},"ts":"1676527316800"} 2023-02-16 06:01:56,802 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-16 06:01:56,803 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-16 06:01:56,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, UNASSIGN}] 2023-02-16 06:01:56,806 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, UNASSIGN 2023-02-16 06:01:56,806 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, UNASSIGN 2023-02-16 06:01:56,807 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, UNASSIGN 2023-02-16 06:01:56,807 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, UNASSIGN 2023-02-16 06:01:56,807 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, UNASSIGN 2023-02-16 06:01:56,807 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6a2f08b3dd6807aab7d4f64fd2100ddd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:56,807 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316807"}]},"ts":"1676527316807"} 2023-02-16 06:01:56,808 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1ff9d03457dfa285ee7d71a79a2ec688, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:56,808 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527316808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316808"}]},"ts":"1676527316808"} 2023-02-16 06:01:56,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=5d54b0efda9e64b101b17c8e82d1673f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:56,808 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316808"}]},"ts":"1676527316808"} 2023-02-16 06:01:56,808 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9a4e8eda753846f54c0762dcfac76f41, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:56,808 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316808"}]},"ts":"1676527316808"} 2023-02-16 06:01:56,808 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=20b79761eadb9a95a00dc3df218f3676, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:56,808 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316808"}]},"ts":"1676527316808"} 2023-02-16 06:01:56,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure 6a2f08b3dd6807aab7d4f64fd2100ddd, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:56,811 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 1ff9d03457dfa285ee7d71a79a2ec688, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:56,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 5d54b0efda9e64b101b17c8e82d1673f, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:56,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 9a4e8eda753846f54c0762dcfac76f41, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:56,813 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, UNASSIGN 2023-02-16 06:01:56,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=41, state=RUNNABLE; CloseRegionProcedure 20b79761eadb9a95a00dc3df218f3676, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:56,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b6fae2ed95adbc75574581e63dcf26a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:56,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316814"}]},"ts":"1676527316814"} 2023-02-16 06:01:56,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, UNASSIGN 2023-02-16 06:01:56,816 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, UNASSIGN 2023-02-16 06:01:56,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure b6fae2ed95adbc75574581e63dcf26a3, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:56,817 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, UNASSIGN 2023-02-16 06:01:56,817 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=480c4f6cefd642d467be931fa68dcad8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:56,817 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316817"}]},"ts":"1676527316817"} 2023-02-16 06:01:56,817 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c69fd28608f3217527519596c7dc33a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:56,818 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316817"}]},"ts":"1676527316817"} 2023-02-16 06:01:56,818 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, UNASSIGN 2023-02-16 06:01:56,818 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=9bb4fa3917a13dc7c150c99f75727a6e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:56,818 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316818"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316818"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316818"}]},"ts":"1676527316818"} 2023-02-16 06:01:56,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 480c4f6cefd642d467be931fa68dcad8, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:56,819 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=b1ed6fdf8d86e0bcebb6ff768865ccd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:56,819 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527316819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527316819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527316819"}]},"ts":"1676527316819"} 2023-02-16 06:01:56,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure c69fd28608f3217527519596c7dc33a1, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:56,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 9bb4fa3917a13dc7c150c99f75727a6e, server=jenkins-hbase4.apache.org,40821,1676527311259}] 2023-02-16 06:01:56,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure b1ed6fdf8d86e0bcebb6ff768865ccd3, server=jenkins-hbase4.apache.org,38609,1676527311236}] 2023-02-16 06:01:56,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:56,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:56,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 480c4f6cefd642d467be931fa68dcad8, disabling compactions & flushes 2023-02-16 06:01:56,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. after waiting 0 ms 2023-02-16 06:01:56,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:56,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1ff9d03457dfa285ee7d71a79a2ec688, disabling compactions & flushes 2023-02-16 06:01:56,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. after waiting 0 ms 2023-02-16 06:01:56,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:56,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 06:01:56,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688. 2023-02-16 06:01:56,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8. 2023-02-16 06:01:56,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1ff9d03457dfa285ee7d71a79a2ec688: 2023-02-16 06:01:56,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 480c4f6cefd642d467be931fa68dcad8: 2023-02-16 06:01:56,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:56,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:56,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c69fd28608f3217527519596c7dc33a1, disabling compactions & flushes 2023-02-16 06:01:56,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. after waiting 0 ms 2023-02-16 06:01:56,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,973 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=480c4f6cefd642d467be931fa68dcad8, regionState=CLOSED 2023-02-16 06:01:56,973 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527316973"}]},"ts":"1676527316973"} 2023-02-16 06:01:56,973 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1ff9d03457dfa285ee7d71a79a2ec688, regionState=CLOSED 2023-02-16 06:01:56,974 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527316973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527316973"}]},"ts":"1676527316973"} 2023-02-16 06:01:56,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-16 06:01:56,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 480c4f6cefd642d467be931fa68dcad8, server=jenkins-hbase4.apache.org,38609,1676527311236 in 156 msec 2023-02-16 06:01:56,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-16 06:01:56,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 1ff9d03457dfa285ee7d71a79a2ec688, server=jenkins-hbase4.apache.org,40821,1676527311259 in 164 msec 2023-02-16 06:01:56,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=480c4f6cefd642d467be931fa68dcad8, UNASSIGN in 173 msec 2023-02-16 06:01:56,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:56,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:56,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9a4e8eda753846f54c0762dcfac76f41, disabling compactions & flushes 2023-02-16 06:01:56,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. after waiting 0 ms 2023-02-16 06:01:56,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ff9d03457dfa285ee7d71a79a2ec688, UNASSIGN in 174 msec 2023-02-16 06:01:56,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:56,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1. 2023-02-16 06:01:56,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c69fd28608f3217527519596c7dc33a1: 2023-02-16 06:01:56,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:56,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41. 2023-02-16 06:01:56,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9a4e8eda753846f54c0762dcfac76f41: 2023-02-16 06:01:56,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:56,987 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c69fd28608f3217527519596c7dc33a1, regionState=CLOSED 2023-02-16 06:01:56,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:56,987 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527316987"}]},"ts":"1676527316987"} 2023-02-16 06:01:56,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 20b79761eadb9a95a00dc3df218f3676, disabling compactions & flushes 2023-02-16 06:01:56,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. after waiting 0 ms 2023-02-16 06:01:56,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:56,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:56,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5d54b0efda9e64b101b17c8e82d1673f, disabling compactions & flushes 2023-02-16 06:01:56,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. after waiting 0 ms 2023-02-16 06:01:56,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,988 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9a4e8eda753846f54c0762dcfac76f41, regionState=CLOSED 2023-02-16 06:01:56,988 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527316988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527316988"}]},"ts":"1676527316988"} 2023-02-16 06:01:56,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-16 06:01:56,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure c69fd28608f3217527519596c7dc33a1, server=jenkins-hbase4.apache.org,38609,1676527311236 in 168 msec 2023-02-16 06:01:56,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-16 06:01:56,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c69fd28608f3217527519596c7dc33a1, UNASSIGN in 186 msec 2023-02-16 06:01:56,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 9a4e8eda753846f54c0762dcfac76f41, server=jenkins-hbase4.apache.org,40821,1676527311259 in 177 msec 2023-02-16 06:01:56,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a4e8eda753846f54c0762dcfac76f41, UNASSIGN in 187 msec 2023-02-16 06:01:56,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:56,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:56,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676. 2023-02-16 06:01:56,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 20b79761eadb9a95a00dc3df218f3676: 2023-02-16 06:01:56,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f. 2023-02-16 06:01:56,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5d54b0efda9e64b101b17c8e82d1673f: 2023-02-16 06:01:57,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:57,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:57,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b1ed6fdf8d86e0bcebb6ff768865ccd3, disabling compactions & flushes 2023-02-16 06:01:57,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:57,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:57,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. after waiting 0 ms 2023-02-16 06:01:57,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:57,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 06:01:57,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=20b79761eadb9a95a00dc3df218f3676, regionState=CLOSED 2023-02-16 06:01:57,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527317008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527317008"}]},"ts":"1676527317008"} 2023-02-16 06:01:57,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:57,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:57,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b6fae2ed95adbc75574581e63dcf26a3, disabling compactions & flushes 2023-02-16 06:01:57,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:57,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:57,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. after waiting 0 ms 2023-02-16 06:01:57,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:57,010 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=5d54b0efda9e64b101b17c8e82d1673f, regionState=CLOSED 2023-02-16 06:01:57,010 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527317010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527317010"}]},"ts":"1676527317010"} 2023-02-16 06:01:57,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=41 2023-02-16 06:01:57,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=41, state=SUCCESS; CloseRegionProcedure 20b79761eadb9a95a00dc3df218f3676, server=jenkins-hbase4.apache.org,38609,1676527311236 in 197 msec 2023-02-16 06:01:57,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-16 06:01:57,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 5d54b0efda9e64b101b17c8e82d1673f, server=jenkins-hbase4.apache.org,40821,1676527311259 in 199 msec 2023-02-16 06:01:57,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20b79761eadb9a95a00dc3df218f3676, UNASSIGN in 209 msec 2023-02-16 06:01:57,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5d54b0efda9e64b101b17c8e82d1673f, UNASSIGN in 210 msec 2023-02-16 06:01:57,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3. 2023-02-16 06:01:57,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b1ed6fdf8d86e0bcebb6ff768865ccd3: 2023-02-16 06:01:57,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:57,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:57,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a2f08b3dd6807aab7d4f64fd2100ddd, disabling compactions & flushes 2023-02-16 06:01:57,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:57,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:57,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. after waiting 0 ms 2023-02-16 06:01:57,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:57,018 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=b1ed6fdf8d86e0bcebb6ff768865ccd3, regionState=CLOSED 2023-02-16 06:01:57,018 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676527317018"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527317018"}]},"ts":"1676527317018"} 2023-02-16 06:01:57,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-16 06:01:57,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure b1ed6fdf8d86e0bcebb6ff768865ccd3, server=jenkins-hbase4.apache.org,38609,1676527311236 in 195 msec 2023-02-16 06:01:57,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b1ed6fdf8d86e0bcebb6ff768865ccd3, UNASSIGN in 217 msec 2023-02-16 06:01:57,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:57,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3. 2023-02-16 06:01:57,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b6fae2ed95adbc75574581e63dcf26a3: 2023-02-16 06:01:57,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:57,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd. 2023-02-16 06:01:57,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a2f08b3dd6807aab7d4f64fd2100ddd: 2023-02-16 06:01:57,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:57,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:57,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9bb4fa3917a13dc7c150c99f75727a6e, disabling compactions & flushes 2023-02-16 06:01:57,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:57,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:57,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. after waiting 0 ms 2023-02-16 06:01:57,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:57,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b6fae2ed95adbc75574581e63dcf26a3, regionState=CLOSED 2023-02-16 06:01:57,041 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527317040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527317040"}]},"ts":"1676527317040"} 2023-02-16 06:01:57,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:57,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6a2f08b3dd6807aab7d4f64fd2100ddd, regionState=CLOSED 2023-02-16 06:01:57,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527317042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527317042"}]},"ts":"1676527317042"} 2023-02-16 06:01:57,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-16 06:01:57,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure 6a2f08b3dd6807aab7d4f64fd2100ddd, server=jenkins-hbase4.apache.org,38609,1676527311236 in 233 msec 2023-02-16 06:01:57,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:01:57,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e. 2023-02-16 06:01:57,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-16 06:01:57,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure b6fae2ed95adbc75574581e63dcf26a3, server=jenkins-hbase4.apache.org,40821,1676527311259 in 226 msec 2023-02-16 06:01:57,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9bb4fa3917a13dc7c150c99f75727a6e: 2023-02-16 06:01:57,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a2f08b3dd6807aab7d4f64fd2100ddd, UNASSIGN in 241 msec 2023-02-16 06:01:57,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b6fae2ed95adbc75574581e63dcf26a3, UNASSIGN in 242 msec 2023-02-16 06:01:57,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:57,049 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=9bb4fa3917a13dc7c150c99f75727a6e, regionState=CLOSED 2023-02-16 06:01:57,049 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676527317049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527317049"}]},"ts":"1676527317049"} 2023-02-16 06:01:57,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-16 06:01:57,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 9bb4fa3917a13dc7c150c99f75727a6e, server=jenkins-hbase4.apache.org,40821,1676527311259 in 231 msec 2023-02-16 06:01:57,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-16 06:01:57,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9bb4fa3917a13dc7c150c99f75727a6e, UNASSIGN in 248 msec 2023-02-16 06:01:57,054 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527317054"}]},"ts":"1676527317054"} 2023-02-16 06:01:57,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-16 06:01:57,057 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-16 06:01:57,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 265 msec 2023-02-16 06:01:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 06:01:57,101 INFO [Listener at localhost/44483] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-16 06:01:57,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,108 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 06:01:57,111 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:57,124 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:57,131 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/recovered.edits] 2023-02-16 06:01:57,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/recovered.edits] 2023-02-16 06:01:57,132 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/recovered.edits] 2023-02-16 06:01:57,132 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/recovered.edits] 2023-02-16 06:01:57,133 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/recovered.edits] 2023-02-16 06:01:57,133 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/recovered.edits] 2023-02-16 06:01:57,133 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/recovered.edits] 2023-02-16 06:01:57,134 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/recovered.edits] 2023-02-16 06:01:57,141 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/39a7a512e5484970b66fe3ce3dd1bc16 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/39a7a512e5484970b66fe3ce3dd1bc16 2023-02-16 06:01:57,144 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/9a1ddcbbe789489385ba206b4ffb47b2 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f1/9a1ddcbbe789489385ba206b4ffb47b2 2023-02-16 06:01:57,144 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/1cd2352789f040a7a4cb1dfe4be2f3d4 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/1cd2352789f040a7a4cb1dfe4be2f3d4 2023-02-16 06:01:57,144 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/0978bd0a037d4da38a4c04293dbdbfa3 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/0978bd0a037d4da38a4c04293dbdbfa3 2023-02-16 06:01:57,145 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d276dcf7c3c4497b0d27fb34b94f557 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d276dcf7c3c4497b0d27fb34b94f557 2023-02-16 06:01:57,145 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/4e78747e5273495eb88dd2f8e9d4162f to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/4e78747e5273495eb88dd2f8e9d4162f 2023-02-16 06:01:57,146 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/0cceb852e25f4ac4aed039568d50f0c2 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/0cceb852e25f4ac4aed039568d50f0c2 2023-02-16 06:01:57,148 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/24200af5d1f548d0b34c7921e977e37f to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/24200af5d1f548d0b34c7921e977e37f 2023-02-16 06:01:57,149 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/ccf04f4dfde84cb681e01e3c9506de6a to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f1/ccf04f4dfde84cb681e01e3c9506de6a 2023-02-16 06:01:57,150 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/641ee546069b48658d5e3092d30bce56 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f1/641ee546069b48658d5e3092d30bce56 2023-02-16 06:01:57,150 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/dbd3081562fc471f8b014a9bfb17067a to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f1/dbd3081562fc471f8b014a9bfb17067a 2023-02-16 06:01:57,150 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/512a27a1f1814bad8e34470c3675da8c to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f1/512a27a1f1814bad8e34470c3675da8c 2023-02-16 06:01:57,150 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d9b4a6caf5544c885331be2464f64e0 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f1/2d9b4a6caf5544c885331be2464f64e0 2023-02-16 06:01:57,151 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/recovered.edits/6.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3/recovered.edits/6.seqid 2023-02-16 06:01:57,152 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b1ed6fdf8d86e0bcebb6ff768865ccd3 2023-02-16 06:01:57,152 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:57,153 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/e59fbf48745149edaa459c9191a5fa8d to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f1/e59fbf48745149edaa459c9191a5fa8d 2023-02-16 06:01:57,154 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/d18e0f7abe8e42409bc144205701fb20 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/d18e0f7abe8e42409bc144205701fb20 2023-02-16 06:01:57,156 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/4ff9deaf810840f48d20ba6795e89899 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/4ff9deaf810840f48d20ba6795e89899 2023-02-16 06:01:57,158 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/e214e94d970b44ab82fa589068207ae9 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/f2/e214e94d970b44ab82fa589068207ae9 2023-02-16 06:01:57,158 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/recovered.edits] 2023-02-16 06:01:57,159 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/854a25e443b54c5093cf233e74633632 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/854a25e443b54c5093cf233e74633632 2023-02-16 06:01:57,160 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/044b30dd4f5944839e3c3ce0651612ea to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/044b30dd4f5944839e3c3ce0651612ea 2023-02-16 06:01:57,161 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/59107092a7ec466ab949579a76043f93 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/f2/59107092a7ec466ab949579a76043f93 2023-02-16 06:01:57,162 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/d4f9747952314f6fb53a91f5a08b85f2 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/d4f9747952314f6fb53a91f5a08b85f2 2023-02-16 06:01:57,165 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/0b5b8c581cab41fa8b10cd62b7dd19b0 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/0b5b8c581cab41fa8b10cd62b7dd19b0 2023-02-16 06:01:57,165 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/eb61ebfd76fc45f68ef6b08063ac0b4e to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/f2/eb61ebfd76fc45f68ef6b08063ac0b4e 2023-02-16 06:01:57,166 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/6cee3c2ed33c4a5aa27878f6fd85000f to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/f2/6cee3c2ed33c4a5aa27878f6fd85000f 2023-02-16 06:01:57,165 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/96a3e5e10e6a41a4bd2e69488bb8261b to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/96a3e5e10e6a41a4bd2e69488bb8261b 2023-02-16 06:01:57,168 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/dfb8101a03e149eda9da08204f437786 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/f2/dfb8101a03e149eda9da08204f437786 2023-02-16 06:01:57,169 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f/recovered.edits/12.seqid 2023-02-16 06:01:57,170 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/2dffa86840fd43e3818448b2bc809d0d to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/2dffa86840fd43e3818448b2bc809d0d 2023-02-16 06:01:57,170 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/5d54b0efda9e64b101b17c8e82d1673f 2023-02-16 06:01:57,171 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:57,171 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e/recovered.edits/12.seqid 2023-02-16 06:01:57,172 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/e5a107a25c9647888854380cfb2c6e28 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/f2/e5a107a25c9647888854380cfb2c6e28 2023-02-16 06:01:57,172 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/1b23249fb69a4b9fad13ca0f52894846 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/f2/1b23249fb69a4b9fad13ca0f52894846 2023-02-16 06:01:57,174 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9bb4fa3917a13dc7c150c99f75727a6e 2023-02-16 06:01:57,178 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/bbee8e7fcfd64dcab867a3b187917084 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f1/bbee8e7fcfd64dcab867a3b187917084 2023-02-16 06:01:57,178 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f1, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/f2, FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/recovered.edits] 2023-02-16 06:01:57,179 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676/recovered.edits/12.seqid 2023-02-16 06:01:57,180 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/20b79761eadb9a95a00dc3df218f3676 2023-02-16 06:01:57,180 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8/recovered.edits/12.seqid 2023-02-16 06:01:57,181 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3/recovered.edits/12.seqid 2023-02-16 06:01:57,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1/recovered.edits/12.seqid 2023-02-16 06:01:57,182 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/480c4f6cefd642d467be931fa68dcad8 2023-02-16 06:01:57,182 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/b6fae2ed95adbc75574581e63dcf26a3 2023-02-16 06:01:57,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/c69fd28608f3217527519596c7dc33a1 2023-02-16 06:01:57,183 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41/recovered.edits/12.seqid 2023-02-16 06:01:57,184 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a4e8eda753846f54c0762dcfac76f41 2023-02-16 06:01:57,184 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/2d5a958eec4b465c959ba5f24fc4100e to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/2d5a958eec4b465c959ba5f24fc4100e 2023-02-16 06:01:57,186 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/f9969fa0e7634b7b832a357a2998a250 to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/f2/f9969fa0e7634b7b832a357a2998a250 2023-02-16 06:01:57,187 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/recovered.edits/6.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688/recovered.edits/6.seqid 2023-02-16 06:01:57,187 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ff9d03457dfa285ee7d71a79a2ec688 2023-02-16 06:01:57,188 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/recovered.edits/12.seqid to hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/archive/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd/recovered.edits/12.seqid 2023-02-16 06:01:57,189 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a2f08b3dd6807aab7d4f64fd2100ddd 2023-02-16 06:01:57,189 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 06:01:57,191 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,195 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-16 06:01:57,197 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527317198"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,200 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 06:01:57,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b1ed6fdf8d86e0bcebb6ff768865ccd3, NAME => 'testWithMockedMapReduceMultiRegion,,1676527312489.b1ed6fdf8d86e0bcebb6ff768865ccd3.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 9bb4fa3917a13dc7c150c99f75727a6e, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676527312489.9bb4fa3917a13dc7c150c99f75727a6e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => c69fd28608f3217527519596c7dc33a1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676527312489.c69fd28608f3217527519596c7dc33a1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 480c4f6cefd642d467be931fa68dcad8, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676527312489.480c4f6cefd642d467be931fa68dcad8.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => b6fae2ed95adbc75574581e63dcf26a3, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676527312489.b6fae2ed95adbc75574581e63dcf26a3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 5d54b0efda9e64b101b17c8e82d1673f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676527312489.5d54b0efda9e64b101b17c8e82d1673f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9a4e8eda753846f54c0762dcfac76f41, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676527312489.9a4e8eda753846f54c0762dcfac76f41.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 20b79761eadb9a95a00dc3df218f3676, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676527312489.20b79761eadb9a95a00dc3df218f3676.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 6a2f08b3dd6807aab7d4f64fd2100ddd, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676527312489.6a2f08b3dd6807aab7d4f64fd2100ddd.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 1ff9d03457dfa285ee7d71a79a2ec688, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676527312489.1ff9d03457dfa285ee7d71a79a2ec688.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 06:01:57,200 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-16 06:01:57,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676527317200"}]},"ts":"9223372036854775807"} 2023-02-16 06:01:57,204 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-16 06:01:57,206 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 06:01:57,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 104 msec 2023-02-16 06:01:57,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35819] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 06:01:57,211 INFO [Listener at localhost/44483] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-16 06:01:57,211 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:01:57,211 INFO [Listener at localhost/44483] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:01:57,211 DEBUG [Listener at localhost/44483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b67361e to 127.0.0.1:58053 2023-02-16 06:01:57,211 DEBUG [Listener at localhost/44483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,211 DEBUG [Listener at localhost/44483] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:01:57,211 DEBUG [Listener at localhost/44483] util.JVMClusterUtil(257): Found active master hash=688028103, stopped=false 2023-02-16 06:01:57,211 INFO [Listener at localhost/44483] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:57,214 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:57,214 INFO [Listener at localhost/44483] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:01:57,214 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:57,214 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:57,214 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:57,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:57,215 DEBUG [Listener at localhost/44483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02f6b419 to 127.0.0.1:58053 2023-02-16 06:01:57,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:57,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:57,215 DEBUG [Listener at localhost/44483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,216 INFO [Listener at localhost/44483] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38609,1676527311236' ***** 2023-02-16 06:01:57,216 INFO [Listener at localhost/44483] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:57,216 INFO [Listener at localhost/44483] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40821,1676527311259' ***** 2023-02-16 06:01:57,216 INFO [Listener at localhost/44483] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:01:57,216 INFO [RS:0;jenkins-hbase4:38609] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:57,216 INFO [RS:1;jenkins-hbase4:40821] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:01:57,216 INFO [RS:1;jenkins-hbase4:40821] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:57,217 INFO [RS:1;jenkins-hbase4:40821] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:57,217 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:57,217 DEBUG [RS:1;jenkins-hbase4:40821] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e34c18f to 127.0.0.1:58053 2023-02-16 06:01:57,217 DEBUG [RS:1;jenkins-hbase4:40821] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,217 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40821,1676527311259; all regions closed. 2023-02-16 06:01:57,216 INFO [RS:0;jenkins-hbase4:38609] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:01:57,218 INFO [RS:0;jenkins-hbase4:38609] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:01:57,216 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:57,218 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(3304): Received CLOSE for 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:57,217 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:01:57,219 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:57,220 DEBUG [RS:0;jenkins-hbase4:38609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1361642d to 127.0.0.1:58053 2023-02-16 06:01:57,221 DEBUG [RS:0;jenkins-hbase4:38609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 320fc30ebe116699bd23092cc5865d84, disabling compactions & flushes 2023-02-16 06:01:57,221 INFO [RS:0;jenkins-hbase4:38609] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:57,221 INFO [RS:0;jenkins-hbase4:38609] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:57,221 INFO [RS:0;jenkins-hbase4:38609] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:57,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:57,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:57,221 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:01:57,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. after waiting 0 ms 2023-02-16 06:01:57,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:57,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 320fc30ebe116699bd23092cc5865d84 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:01:57,221 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 06:01:57,221 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1479): Online Regions={320fc30ebe116699bd23092cc5865d84=hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 06:01:57,221 DEBUG [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1505): Waiting on 1588230740, 320fc30ebe116699bd23092cc5865d84 2023-02-16 06:01:57,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:57,224 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:57,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:57,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:57,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:57,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-16 06:01:57,226 DEBUG [RS:1;jenkins-hbase4:40821] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/oldWALs 2023-02-16 06:01:57,227 INFO [RS:1;jenkins-hbase4:40821] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40821%2C1676527311259:(num 1676527312563) 2023-02-16 06:01:57,227 DEBUG [RS:1;jenkins-hbase4:40821] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,227 INFO [RS:1;jenkins-hbase4:40821] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:57,227 INFO [RS:1;jenkins-hbase4:40821] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:57,227 INFO [RS:1;jenkins-hbase4:40821] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:01:57,227 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:57,227 INFO [RS:1;jenkins-hbase4:40821] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:01:57,227 INFO [RS:1;jenkins-hbase4:40821] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:01:57,228 INFO [RS:1;jenkins-hbase4:40821] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40821 2023-02-16 06:01:57,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/.tmp/info/769ec6ed57ff4a7b8ce14a36b5932c07 2023-02-16 06:01:57,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/.tmp/info/68e3a6fbae434e4da673affa7b9cb7a0 2023-02-16 06:01:57,241 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68e3a6fbae434e4da673affa7b9cb7a0 2023-02-16 06:01:57,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/.tmp/info/769ec6ed57ff4a7b8ce14a36b5932c07 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/info/769ec6ed57ff4a7b8ce14a36b5932c07 2023-02-16 06:01:57,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/info/769ec6ed57ff4a7b8ce14a36b5932c07, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:01:57,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 320fc30ebe116699bd23092cc5865d84 in 25ms, sequenceid=6, compaction requested=false 2023-02-16 06:01:57,248 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/.tmp/rep_barrier/50144f68a75949fda94e86bd8574fa16 2023-02-16 06:01:57,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/namespace/320fc30ebe116699bd23092cc5865d84/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:01:57,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:57,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 320fc30ebe116699bd23092cc5865d84: 2023-02-16 06:01:57,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527311826.320fc30ebe116699bd23092cc5865d84. 2023-02-16 06:01:57,253 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50144f68a75949fda94e86bd8574fa16 2023-02-16 06:01:57,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/.tmp/table/08463d53dea84a749e811d586429542f 2023-02-16 06:01:57,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08463d53dea84a749e811d586429542f 2023-02-16 06:01:57,265 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/.tmp/info/68e3a6fbae434e4da673affa7b9cb7a0 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/info/68e3a6fbae434e4da673affa7b9cb7a0 2023-02-16 06:01:57,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68e3a6fbae434e4da673affa7b9cb7a0 2023-02-16 06:01:57,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/info/68e3a6fbae434e4da673affa7b9cb7a0, entries=30, sequenceid=57, filesize=8.3 K 2023-02-16 06:01:57,269 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/.tmp/rep_barrier/50144f68a75949fda94e86bd8574fa16 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/rep_barrier/50144f68a75949fda94e86bd8574fa16 2023-02-16 06:01:57,271 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:57,272 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50144f68a75949fda94e86bd8574fa16 2023-02-16 06:01:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/rep_barrier/50144f68a75949fda94e86bd8574fa16, entries=10, sequenceid=57, filesize=6.1 K 2023-02-16 06:01:57,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/.tmp/table/08463d53dea84a749e811d586429542f as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/table/08463d53dea84a749e811d586429542f 2023-02-16 06:01:57,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08463d53dea84a749e811d586429542f 2023-02-16 06:01:57,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/table/08463d53dea84a749e811d586429542f, entries=13, sequenceid=57, filesize=6.1 K 2023-02-16 06:01:57,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=57, compaction requested=false 2023-02-16 06:01:57,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 06:01:57,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:01:57,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:57,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:57,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:57,289 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:01:57,319 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:57,319 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:57,319 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40821,1676527311259 2023-02-16 06:01:57,319 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:57,319 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8e342ad rejected from java.util.concurrent.ThreadPoolExecutor@cdcd769[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,320 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:57,320 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a39e1c0 rejected from java.util.concurrent.ThreadPoolExecutor@cdcd769[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,322 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40821,1676527311259] 2023-02-16 06:01:57,322 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40821,1676527311259; numProcessing=1 2023-02-16 06:01:57,323 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40821,1676527311259 already deleted, retry=false 2023-02-16 06:01:57,323 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40821,1676527311259 expired; onlineServers=1 2023-02-16 06:01:57,424 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38609,1676527311236; all regions closed. 2023-02-16 06:01:57,429 DEBUG [RS:0;jenkins-hbase4:38609] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/oldWALs 2023-02-16 06:01:57,429 INFO [RS:0;jenkins-hbase4:38609] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38609%2C1676527311236.meta:.meta(num 1676527311768) 2023-02-16 06:01:57,432 DEBUG [RS:0;jenkins-hbase4:38609] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/oldWALs 2023-02-16 06:01:57,432 INFO [RS:0;jenkins-hbase4:38609] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38609%2C1676527311236:(num 1676527312193) 2023-02-16 06:01:57,432 DEBUG [RS:0;jenkins-hbase4:38609] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,432 INFO [RS:0;jenkins-hbase4:38609] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:01:57,433 INFO [RS:0;jenkins-hbase4:38609] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:01:57,433 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:57,434 INFO [RS:0;jenkins-hbase4:38609] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38609 2023-02-16 06:01:57,435 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38609,1676527311236 2023-02-16 06:01:57,435 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:57,435 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1dad6ac7 rejected from java.util.concurrent.ThreadPoolExecutor@1992edaa[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,437 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38609,1676527311236] 2023-02-16 06:01:57,437 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38609,1676527311236; numProcessing=2 2023-02-16 06:01:57,439 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38609,1676527311236 already deleted, retry=false 2023-02-16 06:01:57,439 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38609,1676527311236 expired; onlineServers=0 2023-02-16 06:01:57,439 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35819,1676527311196' ***** 2023-02-16 06:01:57,439 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:01:57,440 DEBUG [M:0;jenkins-hbase4:35819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d3df83f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:57,440 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35819,1676527311196 2023-02-16 06:01:57,440 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35819,1676527311196; all regions closed. 2023-02-16 06:01:57,440 DEBUG [M:0;jenkins-hbase4:35819] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:01:57,440 DEBUG [M:0;jenkins-hbase4:35819] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:01:57,440 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:01:57,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527311416] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527311416,5,FailOnTimeoutGroup] 2023-02-16 06:01:57,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527311416] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527311416,5,FailOnTimeoutGroup] 2023-02-16 06:01:57,440 DEBUG [M:0;jenkins-hbase4:35819] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:01:57,441 INFO [M:0;jenkins-hbase4:35819] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:01:57,441 INFO [M:0;jenkins-hbase4:35819] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:01:57,441 INFO [M:0;jenkins-hbase4:35819] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:01:57,441 DEBUG [M:0;jenkins-hbase4:35819] master.HMaster(1512): Stopping service threads 2023-02-16 06:01:57,442 INFO [M:0;jenkins-hbase4:35819] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:01:57,442 ERROR [M:0;jenkins-hbase4:35819] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:01:57,442 INFO [M:0;jenkins-hbase4:35819] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:01:57,442 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:01:57,443 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:57,443 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:57,443 DEBUG [M:0;jenkins-hbase4:35819] zookeeper.ZKUtil(398): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 06:01:57,443 WARN [M:0;jenkins-hbase4:35819] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 06:01:57,443 INFO [M:0;jenkins-hbase4:35819] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:01:57,443 INFO [M:0;jenkins-hbase4:35819] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:01:57,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:57,443 DEBUG [M:0;jenkins-hbase4:35819] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:57,443 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:57,444 DEBUG [M:0;jenkins-hbase4:35819] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:57,444 DEBUG [M:0;jenkins-hbase4:35819] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:57,444 DEBUG [M:0;jenkins-hbase4:35819] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:57,444 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-16 06:01:57,452 INFO [M:0;jenkins-hbase4:35819] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0ddbb8655b664bb38d8d3fbec3ec9b91 2023-02-16 06:01:57,455 DEBUG [M:0;jenkins-hbase4:35819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0ddbb8655b664bb38d8d3fbec3ec9b91 as hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0ddbb8655b664bb38d8d3fbec3ec9b91 2023-02-16 06:01:57,458 INFO [M:0;jenkins-hbase4:35819] regionserver.HStore(1080): Added hdfs://localhost:35921/user/jenkins/test-data/d4666723-828f-186d-6496-5644786098ee/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0ddbb8655b664bb38d8d3fbec3ec9b91, entries=53, sequenceid=357, filesize=10.7 K 2023-02-16 06:01:57,459 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171122, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false 2023-02-16 06:01:57,459 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:57,460 DEBUG [M:0;jenkins-hbase4:35819] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:57,462 INFO [M:0;jenkins-hbase4:35819] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:01:57,462 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:01:57,463 INFO [M:0;jenkins-hbase4:35819] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35819 2023-02-16 06:01:57,465 DEBUG [M:0;jenkins-hbase4:35819] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35819,1676527311196 already deleted, retry=false 2023-02-16 06:01:57,521 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:57,521 INFO [RS:1;jenkins-hbase4:40821] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40821,1676527311259; zookeeper connection closed. 2023-02-16 06:01:57,521 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1250d7fd rejected from java.util.concurrent.ThreadPoolExecutor@cdcd769[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,521 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:40821-0x1005bb883020002, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:57,521 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d31556b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d31556b 2023-02-16 06:01:57,521 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ce364c6 rejected from java.util.concurrent.ThreadPoolExecutor@cdcd769[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,721 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:57,721 INFO [M:0;jenkins-hbase4:35819] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35819,1676527311196; zookeeper connection closed. 2023-02-16 06:01:57,721 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@470b350b rejected from java.util.concurrent.ThreadPoolExecutor@4334a932[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,722 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): master:35819-0x1005bb883020000, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:57,722 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29c72366 rejected from java.util.concurrent.ThreadPoolExecutor@4334a932[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,821 INFO [RS:0;jenkins-hbase4:38609] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38609,1676527311236; zookeeper connection closed. 2023-02-16 06:01:57,821 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:57,822 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@539c0aa3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@539c0aa3 2023-02-16 06:01:57,822 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b0b61e2 rejected from java.util.concurrent.ThreadPoolExecutor@1992edaa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,822 DEBUG [Listener at localhost/44483-EventThread] zookeeper.ZKWatcher(600): regionserver:38609-0x1005bb883020001, quorum=127.0.0.1:58053, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:01:57,822 INFO [Listener at localhost/44483] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:01:57,822 ERROR [Listener at localhost/44483-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63f784b1 rejected from java.util.concurrent.ThreadPoolExecutor@1992edaa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:01:57,822 WARN [Listener at localhost/44483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:57,829 INFO [Listener at localhost/44483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:57,936 WARN [BP-460034312-172.31.14.131-1676527310606 heartbeating to localhost/127.0.0.1:35921] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:57,939 WARN [BP-460034312-172.31.14.131-1676527310606 heartbeating to localhost/127.0.0.1:35921] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-460034312-172.31.14.131-1676527310606 (Datanode Uuid d3d04ccf-3cdd-4473-b3cd-4e119b8f95d9) service to localhost/127.0.0.1:35921 2023-02-16 06:01:57,939 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/dfs/data/data3/current/BP-460034312-172.31.14.131-1676527310606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:57,940 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/dfs/data/data4/current/BP-460034312-172.31.14.131-1676527310606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:57,941 WARN [Listener at localhost/44483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:01:57,945 INFO [Listener at localhost/44483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:58,053 WARN [BP-460034312-172.31.14.131-1676527310606 heartbeating to localhost/127.0.0.1:35921] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:01:58,054 WARN [BP-460034312-172.31.14.131-1676527310606 heartbeating to localhost/127.0.0.1:35921] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-460034312-172.31.14.131-1676527310606 (Datanode Uuid d00ccf13-ea29-440a-acce-310ff89f6a62) service to localhost/127.0.0.1:35921 2023-02-16 06:01:58,054 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/dfs/data/data1/current/BP-460034312-172.31.14.131-1676527310606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:58,055 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/cluster_2361e56c-97d5-37e6-d6c3-6fe2e6f35f63/dfs/data/data2/current/BP-460034312-172.31.14.131-1676527310606] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:01:58,066 INFO [Listener at localhost/44483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:01:58,186 INFO [Listener at localhost/44483] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:01:58,226 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:01:58,241 INFO [Listener at localhost/44483] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=228 (was 178) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35819,1676527311196)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:35921 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:35921 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35921 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:35921 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:35921 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44483.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:35921 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:35921 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=644 (was 574) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 366), ProcessCount=168 (was 168), AvailableMemoryMB=1801 (was 1882) 2023-02-16 06:01:58,253 INFO [Listener at localhost/44483] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=228, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=168, AvailableMemoryMB=1801 2023-02-16 06:01:58,263 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/hadoop.log.dir so I do NOT create it in target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c 2023-02-16 06:01:58,264 WARN [Listener at localhost/44483] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/hadoop.tmp.dir so I do NOT create it in target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c 2023-02-16 06:01:58,264 WARN [Listener at localhost/44483] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a286fe5d-71c8-491c-2046-3291c623a574/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 06:01:58,264 DEBUG [Listener at localhost/44483] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883, deleteOnExit=true 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/test.cache.data in system properties and HBase conf 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:01:58,264 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:01:58,265 DEBUG [Listener at localhost/44483] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:01:58,265 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:01:58,266 INFO [Listener at localhost/44483] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:01:58,270 WARN [Listener at localhost/44483] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:58,270 WARN [Listener at localhost/44483] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:58,319 WARN [Listener at localhost/44483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:58,323 INFO [Listener at localhost/44483] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:58,329 INFO [Listener at localhost/44483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/java.io.tmpdir/Jetty_localhost_34157_hdfs____ftr4fw/webapp 2023-02-16 06:01:58,422 INFO [Listener at localhost/44483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34157 2023-02-16 06:01:58,426 WARN [Listener at localhost/44483] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:01:58,426 WARN [Listener at localhost/44483] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:01:58,504 WARN [Listener at localhost/41251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:58,515 WARN [Listener at localhost/41251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:58,517 WARN [Listener at localhost/41251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:58,518 INFO [Listener at localhost/41251] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:58,527 INFO [Listener at localhost/41251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/java.io.tmpdir/Jetty_localhost_40959_datanode____9zo9oo/webapp 2023-02-16 06:01:58,624 INFO [Listener at localhost/41251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40959 2023-02-16 06:01:58,635 WARN [Listener at localhost/44847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:58,667 WARN [Listener at localhost/44847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:01:58,669 WARN [Listener at localhost/44847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:01:58,670 INFO [Listener at localhost/44847] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:01:58,673 INFO [Listener at localhost/44847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/java.io.tmpdir/Jetty_localhost_41959_datanode____1jpqzr/webapp 2023-02-16 06:01:58,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xecb5632e68a434e1: Processing first storage report for DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420 from datanode 0c969903-08da-4c3c-857d-5bbede503727 2023-02-16 06:01:58,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xecb5632e68a434e1: from storage DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420 node DatanodeRegistration(127.0.0.1:44555, datanodeUuid=0c969903-08da-4c3c-857d-5bbede503727, infoPort=40859, infoSecurePort=0, ipcPort=44847, storageInfo=lv=-57;cid=testClusterID;nsid=294255903;c=1676527318273), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:58,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xecb5632e68a434e1: Processing first storage report for DS-d70a85b1-0587-4612-af39-0a7b2cd51fe0 from datanode 0c969903-08da-4c3c-857d-5bbede503727 2023-02-16 06:01:58,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xecb5632e68a434e1: from storage DS-d70a85b1-0587-4612-af39-0a7b2cd51fe0 node DatanodeRegistration(127.0.0.1:44555, datanodeUuid=0c969903-08da-4c3c-857d-5bbede503727, infoPort=40859, infoSecurePort=0, ipcPort=44847, storageInfo=lv=-57;cid=testClusterID;nsid=294255903;c=1676527318273), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:58,795 INFO [Listener at localhost/44847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41959 2023-02-16 06:01:58,816 WARN [Listener at localhost/42509] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:01:58,920 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1f1720d71fc00b6: Processing first storage report for DS-bef845f5-8944-4092-a15a-909c43962477 from datanode d7d5d5a4-bdef-440e-a2f5-e10ec416b0dd 2023-02-16 06:01:58,920 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1f1720d71fc00b6: from storage DS-bef845f5-8944-4092-a15a-909c43962477 node DatanodeRegistration(127.0.0.1:36767, datanodeUuid=d7d5d5a4-bdef-440e-a2f5-e10ec416b0dd, infoPort=46675, infoSecurePort=0, ipcPort=42509, storageInfo=lv=-57;cid=testClusterID;nsid=294255903;c=1676527318273), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 06:01:58,920 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1f1720d71fc00b6: Processing first storage report for DS-a82da034-f4f8-403d-90a9-2f1b20f2a1fc from datanode d7d5d5a4-bdef-440e-a2f5-e10ec416b0dd 2023-02-16 06:01:58,920 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1f1720d71fc00b6: from storage DS-a82da034-f4f8-403d-90a9-2f1b20f2a1fc node DatanodeRegistration(127.0.0.1:36767, datanodeUuid=d7d5d5a4-bdef-440e-a2f5-e10ec416b0dd, infoPort=46675, infoSecurePort=0, ipcPort=42509, storageInfo=lv=-57;cid=testClusterID;nsid=294255903;c=1676527318273), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:01:58,939 DEBUG [Listener at localhost/42509] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c 2023-02-16 06:01:58,941 INFO [Listener at localhost/42509] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/zookeeper_0, clientPort=51744, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:01:58,941 INFO [Listener at localhost/42509] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51744 2023-02-16 06:01:58,942 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:58,942 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:58,956 INFO [Listener at localhost/42509] util.FSUtils(479): Created version file at hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb with version=8 2023-02-16 06:01:58,956 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:58,957 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:58,957 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/hbase-staging 2023-02-16 06:01:58,959 INFO [Listener at localhost/42509] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:58,959 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:58,959 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:58,959 INFO [Listener at localhost/42509] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:58,959 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:58,960 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:58,960 INFO [Listener at localhost/42509] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:58,960 INFO [Listener at localhost/42509] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36461 2023-02-16 06:01:58,961 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:58,961 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:58,962 INFO [Listener at localhost/42509] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36461 connecting to ZooKeeper ensemble=127.0.0.1:51744 2023-02-16 06:01:58,969 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:364610x0, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:58,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36461-0x1005bb8a1610000 connected 2023-02-16 06:01:58,990 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:58,990 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:58,991 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:58,991 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36461 2023-02-16 06:01:58,991 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36461 2023-02-16 06:01:58,991 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36461 2023-02-16 06:01:58,994 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36461 2023-02-16 06:01:58,995 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36461 2023-02-16 06:01:58,995 INFO [Listener at localhost/42509] master.HMaster(444): hbase.rootdir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb, hbase.cluster.distributed=false 2023-02-16 06:01:59,009 INFO [Listener at localhost/42509] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:59,009 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:59,009 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:59,009 INFO [Listener at localhost/42509] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:59,009 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:59,009 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:59,010 INFO [Listener at localhost/42509] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:59,010 INFO [Listener at localhost/42509] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41877 2023-02-16 06:01:59,010 INFO [Listener at localhost/42509] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:59,013 DEBUG [Listener at localhost/42509] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:59,013 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:59,014 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:59,015 INFO [Listener at localhost/42509] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41877 connecting to ZooKeeper ensemble=127.0.0.1:51744 2023-02-16 06:01:59,018 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:418770x0, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:59,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41877-0x1005bb8a1610001 connected 2023-02-16 06:01:59,020 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:59,020 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:59,020 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:59,021 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41877 2023-02-16 06:01:59,021 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41877 2023-02-16 06:01:59,021 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41877 2023-02-16 06:01:59,022 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41877 2023-02-16 06:01:59,022 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41877 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:01:59,033 INFO [Listener at localhost/42509] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:01:59,034 INFO [Listener at localhost/42509] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34823 2023-02-16 06:01:59,034 INFO [Listener at localhost/42509] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:01:59,035 DEBUG [Listener at localhost/42509] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:01:59,035 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:59,036 INFO [Listener at localhost/42509] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:59,037 INFO [Listener at localhost/42509] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34823 connecting to ZooKeeper ensemble=127.0.0.1:51744 2023-02-16 06:01:59,039 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:348230x0, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:01:59,041 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): regionserver:348230x0, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:01:59,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34823-0x1005bb8a1610002 connected 2023-02-16 06:01:59,042 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:01:59,043 DEBUG [Listener at localhost/42509] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:01:59,043 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34823 2023-02-16 06:01:59,043 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34823 2023-02-16 06:01:59,043 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34823 2023-02-16 06:01:59,044 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34823 2023-02-16 06:01:59,044 DEBUG [Listener at localhost/42509] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34823 2023-02-16 06:01:59,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,046 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:59,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,052 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:59,052 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:59,052 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:01:59,053 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:59,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36461,1676527318959 from backup master directory 2023-02-16 06:01:59,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:01:59,055 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,056 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:01:59,056 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:59,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/hbase.id with ID: 4c7466f2-1928-4db9-bf57-9163af0c9a1f 2023-02-16 06:01:59,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:01:59,074 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x58185893 to 127.0.0.1:51744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:59,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6300c74e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:59,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:59,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:01:59,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:59,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store-tmp 2023-02-16 06:01:59,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:59,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:01:59,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:59,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:59,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:01:59,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:59,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:01:59,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:59,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/WALs/jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36461%2C1676527318959, suffix=, logDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/WALs/jenkins-hbase4.apache.org,36461,1676527318959, archiveDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/oldWALs, maxLogs=10 2023-02-16 06:01:59,108 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK] 2023-02-16 06:01:59,108 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK] 2023-02-16 06:01:59,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/WALs/jenkins-hbase4.apache.org,36461,1676527318959/jenkins-hbase4.apache.org%2C36461%2C1676527318959.1676527319096 2023-02-16 06:01:59,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK], DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK]] 2023-02-16 06:01:59,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:59,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:59,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:59,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:59,111 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:59,112 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:01:59,112 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:01:59,113 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:59,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:59,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:01:59,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:59,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63859181, jitterRate=-0.04842405021190643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:59,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:01:59,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:01:59,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:01:59,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:01:59,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:01:59,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 06:01:59,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 06:01:59,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:01:59,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:01:59,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:01:59,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:01:59,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:01:59,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:01:59,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:01:59,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:01:59,137 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:01:59,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:01:59,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:01:59,139 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:59,139 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:59,139 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,139 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:01:59,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36461,1676527318959, sessionid=0x1005bb8a1610000, setting cluster-up flag (Was=false) 2023-02-16 06:01:59,144 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:01:59,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,153 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:01:59,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:01:59,158 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.hbase-snapshot/.tmp 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:01:59,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:59,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527349162 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:01:59,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,162 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:59,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:01:59,163 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:01:59,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:01:59,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:01:59,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:01:59,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:01:59,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527319164,5,FailOnTimeoutGroup] 2023-02-16 06:01:59,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527319164,5,FailOnTimeoutGroup] 2023-02-16 06:01:59,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:01:59,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,164 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:59,172 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:59,173 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:59,173 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb 2023-02-16 06:01:59,183 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:59,186 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:59,187 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/info 2023-02-16 06:01:59,188 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:59,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:59,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:59,190 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:59,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:59,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/table 2023-02-16 06:01:59,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:59,192 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,193 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740 2023-02-16 06:01:59,193 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740 2023-02-16 06:01:59,195 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:59,197 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:59,199 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64073379, jitterRate=-0.04523225128650665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:01:59,199 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:01:59,199 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:01:59,199 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:01:59,200 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:01:59,200 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:01:59,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:01:59,202 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:01:59,203 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:01:59,246 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(952): ClusterId : 4c7466f2-1928-4db9-bf57-9163af0c9a1f 2023-02-16 06:01:59,246 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(952): ClusterId : 4c7466f2-1928-4db9-bf57-9163af0c9a1f 2023-02-16 06:01:59,246 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:59,246 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:01:59,248 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:59,248 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:59,248 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:01:59,248 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:01:59,250 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:59,252 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:01:59,252 DEBUG [RS:0;jenkins-hbase4:41877] zookeeper.ReadOnlyZKClient(139): Connect 0x7d172fcf to 127.0.0.1:51744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:59,253 DEBUG [RS:1;jenkins-hbase4:34823] zookeeper.ReadOnlyZKClient(139): Connect 0x674397f2 to 127.0.0.1:51744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:01:59,259 DEBUG [RS:0;jenkins-hbase4:41877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73d0ce1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:59,259 DEBUG [RS:1;jenkins-hbase4:34823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6984656a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:01:59,259 DEBUG [RS:0;jenkins-hbase4:41877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77ef44bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:59,259 DEBUG [RS:1;jenkins-hbase4:34823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dbbfc82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:01:59,268 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34823 2023-02-16 06:01:59,268 INFO [RS:1;jenkins-hbase4:34823] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:59,268 INFO [RS:1;jenkins-hbase4:34823] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:59,268 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:59,269 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36461,1676527318959 with isa=jenkins-hbase4.apache.org/172.31.14.131:34823, startcode=1676527319033 2023-02-16 06:01:59,269 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41877 2023-02-16 06:01:59,269 DEBUG [RS:1;jenkins-hbase4:34823] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:59,269 INFO [RS:0;jenkins-hbase4:41877] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:01:59,269 INFO [RS:0;jenkins-hbase4:41877] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:01:59,269 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:01:59,270 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36461,1676527318959 with isa=jenkins-hbase4.apache.org/172.31.14.131:41877, startcode=1676527319009 2023-02-16 06:01:59,270 DEBUG [RS:0;jenkins-hbase4:41877] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:01:59,270 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32821, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:59,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,272 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40651, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:01:59,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,272 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb 2023-02-16 06:01:59,272 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41251 2023-02-16 06:01:59,272 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:59,273 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb 2023-02-16 06:01:59,273 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41251 2023-02-16 06:01:59,273 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:01:59,274 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:01:59,279 DEBUG [RS:1;jenkins-hbase4:34823] zookeeper.ZKUtil(162): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,279 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34823,1676527319033] 2023-02-16 06:01:59,279 WARN [RS:1;jenkins-hbase4:34823] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:59,279 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41877,1676527319009] 2023-02-16 06:01:59,279 DEBUG [RS:0;jenkins-hbase4:41877] zookeeper.ZKUtil(162): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,279 INFO [RS:1;jenkins-hbase4:34823] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:59,279 WARN [RS:0;jenkins-hbase4:41877] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:01:59,279 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,279 INFO [RS:0;jenkins-hbase4:41877] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:59,279 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,287 DEBUG [RS:1;jenkins-hbase4:34823] zookeeper.ZKUtil(162): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,287 DEBUG [RS:0;jenkins-hbase4:41877] zookeeper.ZKUtil(162): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,287 DEBUG [RS:1;jenkins-hbase4:34823] zookeeper.ZKUtil(162): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,287 DEBUG [RS:0;jenkins-hbase4:41877] zookeeper.ZKUtil(162): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,288 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:59,288 DEBUG [RS:0;jenkins-hbase4:41877] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:01:59,288 INFO [RS:1;jenkins-hbase4:34823] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:59,288 INFO [RS:0;jenkins-hbase4:41877] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:01:59,289 INFO [RS:1;jenkins-hbase4:34823] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:59,289 INFO [RS:1;jenkins-hbase4:34823] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:59,289 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,289 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:59,290 INFO [RS:0;jenkins-hbase4:41877] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:01:59,291 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,291 INFO [RS:0;jenkins-hbase4:41877] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,291 DEBUG [RS:1;jenkins-hbase4:34823] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,295 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:01:59,296 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,296 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,296 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,297 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,297 DEBUG [RS:0;jenkins-hbase4:41877] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:01:59,299 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,299 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,299 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,308 INFO [RS:1;jenkins-hbase4:34823] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:59,308 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34823,1676527319033-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,310 INFO [RS:0;jenkins-hbase4:41877] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:01:59,310 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41877,1676527319009-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,318 INFO [RS:1;jenkins-hbase4:34823] regionserver.Replication(203): jenkins-hbase4.apache.org,34823,1676527319033 started 2023-02-16 06:01:59,318 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34823,1676527319033, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34823, sessionid=0x1005bb8a1610002 2023-02-16 06:01:59,318 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:59,318 DEBUG [RS:1;jenkins-hbase4:34823] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,318 DEBUG [RS:1;jenkins-hbase4:34823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34823,1676527319033' 2023-02-16 06:01:59,318 DEBUG [RS:1;jenkins-hbase4:34823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:59,319 DEBUG [RS:1;jenkins-hbase4:34823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:59,319 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:59,319 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:59,319 DEBUG [RS:1;jenkins-hbase4:34823] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,319 DEBUG [RS:1;jenkins-hbase4:34823] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34823,1676527319033' 2023-02-16 06:01:59,319 DEBUG [RS:1;jenkins-hbase4:34823] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:59,320 DEBUG [RS:1;jenkins-hbase4:34823] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:59,320 DEBUG [RS:1;jenkins-hbase4:34823] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:59,320 INFO [RS:1;jenkins-hbase4:34823] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:59,320 INFO [RS:1;jenkins-hbase4:34823] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:59,320 INFO [RS:0;jenkins-hbase4:41877] regionserver.Replication(203): jenkins-hbase4.apache.org,41877,1676527319009 started 2023-02-16 06:01:59,320 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41877,1676527319009, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41877, sessionid=0x1005bb8a1610001 2023-02-16 06:01:59,320 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:01:59,320 DEBUG [RS:0;jenkins-hbase4:41877] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,320 DEBUG [RS:0;jenkins-hbase4:41877] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41877,1676527319009' 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41877,1676527319009' 2023-02-16 06:01:59,321 DEBUG [RS:0;jenkins-hbase4:41877] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:01:59,322 DEBUG [RS:0;jenkins-hbase4:41877] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:01:59,322 DEBUG [RS:0;jenkins-hbase4:41877] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:01:59,322 INFO [RS:0;jenkins-hbase4:41877] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:01:59,322 INFO [RS:0;jenkins-hbase4:41877] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:01:59,353 DEBUG [jenkins-hbase4:36461] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:01:59,354 DEBUG [jenkins-hbase4:36461] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:59,355 DEBUG [jenkins-hbase4:36461] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:59,355 DEBUG [jenkins-hbase4:36461] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:59,355 DEBUG [jenkins-hbase4:36461] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:59,355 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34823,1676527319033, state=OPENING 2023-02-16 06:01:59,357 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:01:59,359 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,361 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:59,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34823,1676527319033}] 2023-02-16 06:01:59,515 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,516 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:01:59,517 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:01:59,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:01:59,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:01:59,524 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34823%2C1676527319033.meta, suffix=.meta, logDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,34823,1676527319033, archiveDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/oldWALs, maxLogs=32 2023-02-16 06:01:59,538 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK] 2023-02-16 06:01:59,538 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK] 2023-02-16 06:01:59,540 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,34823,1676527319033/jenkins-hbase4.apache.org%2C34823%2C1676527319033.meta.1676527319524.meta 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK], DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK]] 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:01:59,540 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:01:59,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:01:59,541 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:01:59,542 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/info 2023-02-16 06:01:59,542 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/info 2023-02-16 06:01:59,542 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:01:59,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:01:59,544 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:59,544 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:01:59,544 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:01:59,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:01:59,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/table 2023-02-16 06:01:59,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/table 2023-02-16 06:01:59,545 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:01:59,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740 2023-02-16 06:01:59,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740 2023-02-16 06:01:59,548 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:01:59,549 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:01:59,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74073173, jitterRate=0.10377629101276398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:01:59,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:01:59,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527319515 2023-02-16 06:01:59,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:01:59,554 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:01:59,555 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34823,1676527319033, state=OPEN 2023-02-16 06:01:59,557 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:01:59,557 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:01:59,558 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:01:59,558 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34823,1676527319033 in 198 msec 2023-02-16 06:01:59,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:01:59,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-16 06:01:59,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 402 msec 2023-02-16 06:01:59,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527319561, completionTime=-1 2023-02-16 06:01:59,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:01:59,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:01:59,564 DEBUG [hconnection-0x6dd92f3d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:01:59,565 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57958, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:01:59,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:01:59,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527379567 2023-02-16 06:01:59,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527439567 2023-02-16 06:01:59,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36461,1676527318959-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36461,1676527318959-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36461,1676527318959-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36461, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:01:59,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:01:59,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:01:59,575 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:01:59,575 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:01:59,576 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:01:59,577 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,577 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5 empty. 2023-02-16 06:01:59,578 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,578 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:01:59,586 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:01:59,587 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7123a69f716f14573f631e2e2c3dcc5, NAME => 'hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp 2023-02-16 06:01:59,592 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:59,592 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c7123a69f716f14573f631e2e2c3dcc5, disabling compactions & flushes 2023-02-16 06:01:59,592 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,592 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,592 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. after waiting 0 ms 2023-02-16 06:01:59,592 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,592 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,592 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c7123a69f716f14573f631e2e2c3dcc5: 2023-02-16 06:01:59,594 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:01:59,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527319594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527319594"}]},"ts":"1676527319594"} 2023-02-16 06:01:59,596 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:01:59,597 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:01:59,597 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527319597"}]},"ts":"1676527319597"} 2023-02-16 06:01:59,598 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:01:59,601 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:01:59,602 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:01:59,602 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:01:59,602 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:01:59,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7123a69f716f14573f631e2e2c3dcc5, ASSIGN}] 2023-02-16 06:01:59,604 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c7123a69f716f14573f631e2e2c3dcc5, ASSIGN 2023-02-16 06:01:59,604 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c7123a69f716f14573f631e2e2c3dcc5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34823,1676527319033; forceNewPlan=false, retain=false 2023-02-16 06:01:59,755 INFO [jenkins-hbase4:36461] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:01:59,755 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7123a69f716f14573f631e2e2c3dcc5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,755 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527319755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527319755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527319755"}]},"ts":"1676527319755"} 2023-02-16 06:01:59,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c7123a69f716f14573f631e2e2c3dcc5, server=jenkins-hbase4.apache.org,34823,1676527319033}] 2023-02-16 06:01:59,911 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,912 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34823%2C1676527319033, suffix=, logDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,34823,1676527319033, archiveDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/oldWALs, maxLogs=32 2023-02-16 06:01:59,925 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK] 2023-02-16 06:01:59,925 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK] 2023-02-16 06:01:59,927 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,34823,1676527319033/jenkins-hbase4.apache.org%2C34823%2C1676527319033.1676527319913 2023-02-16 06:01:59,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK], DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK]] 2023-02-16 06:01:59,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7123a69f716f14573f631e2e2c3dcc5, NAME => 'hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:01:59,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:01:59,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,929 INFO [StoreOpener-c7123a69f716f14573f631e2e2c3dcc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,930 DEBUG [StoreOpener-c7123a69f716f14573f631e2e2c3dcc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/info 2023-02-16 06:01:59,930 DEBUG [StoreOpener-c7123a69f716f14573f631e2e2c3dcc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/info 2023-02-16 06:01:59,931 INFO [StoreOpener-c7123a69f716f14573f631e2e2c3dcc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7123a69f716f14573f631e2e2c3dcc5 columnFamilyName info 2023-02-16 06:01:59,931 INFO [StoreOpener-c7123a69f716f14573f631e2e2c3dcc5-1] regionserver.HStore(310): Store=c7123a69f716f14573f631e2e2c3dcc5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:01:59,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:01:59,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:01:59,935 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7123a69f716f14573f631e2e2c3dcc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62113915, jitterRate=-0.07443054020404816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:01:59,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7123a69f716f14573f631e2e2c3dcc5: 2023-02-16 06:01:59,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5., pid=6, masterSystemTime=1676527319908 2023-02-16 06:01:59,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,938 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:01:59,938 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c7123a69f716f14573f631e2e2c3dcc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:01:59,939 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527319938"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527319938"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527319938"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527319938"}]},"ts":"1676527319938"} 2023-02-16 06:01:59,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:01:59,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c7123a69f716f14573f631e2e2c3dcc5, server=jenkins-hbase4.apache.org,34823,1676527319033 in 183 msec 2023-02-16 06:01:59,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:01:59,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c7123a69f716f14573f631e2e2c3dcc5, ASSIGN in 339 msec 2023-02-16 06:01:59,943 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:01:59,943 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527319943"}]},"ts":"1676527319943"} 2023-02-16 06:01:59,944 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:01:59,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:01:59,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-02-16 06:01:59,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:01:59,976 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:59,977 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:01:59,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:01:59,987 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:01:59,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 06:01:59,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:01:59,997 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:00,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 06:02:00,005 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:02:00,009 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:02:00,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.953sec 2023-02-16 06:02:00,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:02:00,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:02:00,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:02:00,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36461,1676527318959-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:02:00,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36461,1676527318959-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:02:00,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:02:00,047 DEBUG [Listener at localhost/42509] zookeeper.ReadOnlyZKClient(139): Connect 0x05c26623 to 127.0.0.1:51744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:00,054 DEBUG [Listener at localhost/42509] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7498fd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:00,055 DEBUG [hconnection-0x4efdf850-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:00,057 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57972, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:00,058 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:02:00,058 DEBUG [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:02:00,060 DEBUG [Listener at localhost/42509] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:02:00,062 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:02:00,062 INFO [Listener at localhost/42509] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:02:00,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:41014 deadline: 1676527380063, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,064 INFO [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-16 06:02:00,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:00,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,068 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:02:00,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-16 06:02:00,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:00,070 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:02:00,073 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,074 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 empty. 2023-02-16 06:02:00,074 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,074 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 06:02:00,084 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:00,085 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 567d0ac9bf0d761789ed9dbd733ae8c0, NAME => 'testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp 2023-02-16 06:02:00,091 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:00,091 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 567d0ac9bf0d761789ed9dbd733ae8c0, disabling compactions & flushes 2023-02-16 06:02:00,092 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. after waiting 0 ms 2023-02-16 06:02:00,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,092 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,092 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:00,093 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:02:00,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676527320094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527320094"}]},"ts":"1676527320094"} 2023-02-16 06:02:00,096 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:02:00,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:02:00,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527320096"}]},"ts":"1676527320096"} 2023-02-16 06:02:00,097 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-16 06:02:00,101 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:00,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:00,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:00,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:00,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, ASSIGN}] 2023-02-16 06:02:00,104 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, ASSIGN 2023-02-16 06:02:00,104 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41877,1676527319009; forceNewPlan=false, retain=false 2023-02-16 06:02:00,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:00,255 INFO [jenkins-hbase4:36461] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:02:00,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=567d0ac9bf0d761789ed9dbd733ae8c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676527320255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527320255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527320255"}]},"ts":"1676527320255"} 2023-02-16 06:02:00,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 567d0ac9bf0d761789ed9dbd733ae8c0, server=jenkins-hbase4.apache.org,41877,1676527319009}] 2023-02-16 06:02:00,324 INFO [RS:0;jenkins-hbase4:41877] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41877%2C1676527319009, suffix=, logDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,41877,1676527319009, archiveDir=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/oldWALs, maxLogs=32 2023-02-16 06:02:00,339 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK] 2023-02-16 06:02:00,339 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK] 2023-02-16 06:02:00,341 INFO [RS:0;jenkins-hbase4:41877] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/WALs/jenkins-hbase4.apache.org,41877,1676527319009/jenkins-hbase4.apache.org%2C41877%2C1676527319009.1676527320324 2023-02-16 06:02:00,343 DEBUG [RS:0;jenkins-hbase4:41877] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44555,DS-45c9e75e-b90d-4502-9c18-f59fb6c1e420,DISK], DatanodeInfoWithStorage[127.0.0.1:36767,DS-bef845f5-8944-4092-a15a-909c43962477,DISK]] 2023-02-16 06:02:00,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:00,409 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,409 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:02:00,411 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37026, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:02:00,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 567d0ac9bf0d761789ed9dbd733ae8c0, NAME => 'testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:00,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:00,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,415 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,416 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1 2023-02-16 06:02:00,416 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1 2023-02-16 06:02:00,416 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 567d0ac9bf0d761789ed9dbd733ae8c0 columnFamilyName f1 2023-02-16 06:02:00,416 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(310): Store=567d0ac9bf0d761789ed9dbd733ae8c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:00,417 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,417 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2 2023-02-16 06:02:00,418 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2 2023-02-16 06:02:00,418 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 567d0ac9bf0d761789ed9dbd733ae8c0 columnFamilyName f2 2023-02-16 06:02:00,418 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(310): Store=567d0ac9bf0d761789ed9dbd733ae8c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:00,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:02:00,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:00,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:00,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 567d0ac9bf0d761789ed9dbd733ae8c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62855330, jitterRate=-0.0633825957775116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:02:00,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:00,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0., pid=12, masterSystemTime=1676527320409 2023-02-16 06:02:00,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=567d0ac9bf0d761789ed9dbd733ae8c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676527320427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527320427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527320427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527320427"}]},"ts":"1676527320427"} 2023-02-16 06:02:00,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 06:02:00,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 567d0ac9bf0d761789ed9dbd733ae8c0, server=jenkins-hbase4.apache.org,41877,1676527319009 in 172 msec 2023-02-16 06:02:00,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 06:02:00,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, ASSIGN in 328 msec 2023-02-16 06:02:00,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:02:00,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527320432"}]},"ts":"1676527320432"} 2023-02-16 06:02:00,433 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-16 06:02:00,435 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:02:00,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 369 msec 2023-02-16 06:02:00,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:00,676 INFO [Listener at localhost/42509] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-16 06:02:00,676 DEBUG [Listener at localhost/42509] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-16 06:02:00,676 INFO [Listener at localhost/42509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:02:00,678 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-16 06:02:00,678 INFO [Listener at localhost/42509] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:02:00,678 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-16 06:02:00,678 INFO [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:02:00,690 DEBUG [hconnection-0x4efdf850-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:00,702 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37036, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:00,709 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41877] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,808 INFO [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:02:00,808 INFO [Listener at localhost/42509] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:02:00,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 06:02:00,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527320809 (current time:1676527320809). 2023-02-16 06:02:00,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:02:00,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] zookeeper.ReadOnlyZKClient(139): Connect 0x00e13ac1 to 127.0.0.1:51744 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:00,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37bc4606, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:00,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:00,815 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57976, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00e13ac1 to 127.0.0.1:51744 2023-02-16 06:02:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:00,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:02:00,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 06:02:00,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 06:02:00,820 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 06:02:00,821 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676527920821 2023-02-16 06:02:00,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 06:02:00,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,823 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 06:02:00,823 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:02:00,823 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:02:00,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 06:02:00,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-16 06:02:00,825 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 06:02:00,825 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676527920825 2023-02-16 06:02:00,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,834 INFO [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 06:02:00,834 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:00,835 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 06:02:00,835 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 06:02:00,835 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,835 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,836 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:00,836 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:00,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:00,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:00,837 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,837 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,837 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:02:00,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 06:02:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 06:02:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 06:02:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 06:02:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41877,1676527319009' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 06:02:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 06:02:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 06:02:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34823,1676527319033' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 06:02:00,841 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,841 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:00,842 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,842 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,842 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:00,842 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,842 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:00,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41877,1676527319009' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 06:02:00,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3535771e[Count = 0] remaining members to acquire global barrier 2023-02-16 06:02:00,843 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 06:02:00,843 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,844 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,844 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,845 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,845 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 06:02:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 06:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 06:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34823,1676527319033' in zk 2023-02-16 06:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 06:02:00,845 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:02:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. started... 2023-02-16 06:02:00,845 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 567d0ac9bf0d761789ed9dbd733ae8c0 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 06:02:00,846 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 06:02:00,846 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:00,846 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 06:02:00,860 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f1/5d79d29073104a7094b259e705ab43e3 2023-02-16 06:02:00,884 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f2/f1491ac5d8bc47d5b6d619d290087855 2023-02-16 06:02:00,888 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f1/5d79d29073104a7094b259e705ab43e3 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/5d79d29073104a7094b259e705ab43e3 2023-02-16 06:02:00,892 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/5d79d29073104a7094b259e705ab43e3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:02:00,892 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f2/f1491ac5d8bc47d5b6d619d290087855 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/f1491ac5d8bc47d5b6d619d290087855 2023-02-16 06:02:00,896 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/f1491ac5d8bc47d5b6d619d290087855, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:02:00,897 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 567d0ac9bf0d761789ed9dbd733ae8c0 in 52ms, sequenceid=5, compaction requested=false 2023-02-16 06:02:00,897 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-16 06:02:00,897 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:00,898 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,898 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:02:00,898 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/5d79d29073104a7094b259e705ab43e3] hfiles 2023-02-16 06:02:00,898 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/5d79d29073104a7094b259e705ab43e3 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,898 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/f1491ac5d8bc47d5b6d619d290087855] hfiles 2023-02-16 06:02:00,898 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/f1491ac5d8bc47d5b6d619d290087855 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,906 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. completed. 2023-02-16 06:02:00,906 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:00,906 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 06:02:00,906 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 06:02:00,906 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,906 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 06:02:00,906 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41877,1676527319009' in zk 2023-02-16 06:02:00,908 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 06:02:00,908 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,908 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,908 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 06:02:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,41877,1676527319009': 2023-02-16 06:02:00,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41877,1676527319009' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 06:02:00,912 INFO [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 06:02:00,912 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:02:00,912 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:02:00,912 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,912 INFO [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:02:00,914 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:00,914 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,914 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:00,915 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:00,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:00,915 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,916 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,918 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:00,919 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,923 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 06:02:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:02:00,925 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,928 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:00,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:00,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,929 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:00,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:00,928 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:00,929 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,929 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:00,929 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,929 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:00,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:00,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:00,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:01,125 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:01,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 06:02:01,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:02:01,127 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 06:02:01,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-16 06:02:01,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,370 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676527320821Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676527320929 (+108 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676527320929Writing data manifest for testWithMockedMapReduceSingleRegion at 1676527320932 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676527321347 (+415 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676527321370 (+23 ms) 2023-02-16 06:02:01,373 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 06:02:01,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 551 msec 2023-02-16 06:02:01,427 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 06:02:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:02:01,429 INFO [Listener at localhost/42509] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:02:01,432 INFO [Listener at localhost/42509] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:02:01,437 INFO [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:02:01,465 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41877] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,565 INFO [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:02:01,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:02:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,575 INFO [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 06:02:01,575 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:01,576 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 06:02:01,576 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 06:02:01,576 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,576 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,578 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:01,578 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:01,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:01,578 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:01,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,578 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,578 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:02:01,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:02:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,579 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 06:02:01,579 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:01,580 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 06:02:01,581 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 06:02:01,581 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34823,1676527319033' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 06:02:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,582 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:02:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,582 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,582 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:01,582 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 06:02:01,582 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:01,583 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 06:02:01,583 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 06:02:01,583 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:02:01,583 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,583 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. started... 2023-02-16 06:02:01,584 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 567d0ac9bf0d761789ed9dbd733ae8c0 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 06:02:01,613 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f1/6de60eb4c4394b799966ab2fe3c79823 2023-02-16 06:02:01,630 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f2/b503af29f57940cb853c4e88ee01e17e 2023-02-16 06:02:01,634 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f1/6de60eb4c4394b799966ab2fe3c79823 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/6de60eb4c4394b799966ab2fe3c79823 2023-02-16 06:02:01,638 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/6de60eb4c4394b799966ab2fe3c79823, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:02:01,639 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/.tmp/f2/b503af29f57940cb853c4e88ee01e17e as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/b503af29f57940cb853c4e88ee01e17e 2023-02-16 06:02:01,643 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/b503af29f57940cb853c4e88ee01e17e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:02:01,643 INFO [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 567d0ac9bf0d761789ed9dbd733ae8c0 in 59ms, sequenceid=9, compaction requested=false 2023-02-16 06:02:01,644 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:01,644 DEBUG [rs(jenkins-hbase4.apache.org,41877,1676527319009)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,644 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 06:02:01,644 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 06:02:01,645 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,645 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 06:02:01,645 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41877,1676527319009' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 06:02:01,646 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,646 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:01,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:01,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:01,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:01,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41877,1676527319009' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 06:02:01,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310ae560[Count = 0] remaining members to acquire global barrier 2023-02-16 06:02:01,648 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 06:02:01,648 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,649 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,649 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,649 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,650 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:02:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 06:02:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 06:02:01,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41877,1676527319009' in zk 2023-02-16 06:02:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 06:02:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 06:02:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34823,1676527319033' in zk 2023-02-16 06:02:01,651 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,651 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 06:02:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:01,651 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:01,651 DEBUG [member: 'jenkins-hbase4.apache.org,41877,1676527319009' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 06:02:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:01,653 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 06:02:01,653 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:01,653 DEBUG [member: 'jenkins-hbase4.apache.org,34823,1676527319033' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 06:02:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,41877,1676527319009': 2023-02-16 06:02:01,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41877,1676527319009' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 06:02:01,655 INFO [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 06:02:01,655 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:02:01,655 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:02:01,655 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,655 INFO [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:02:01,656 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,656 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:01,656 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:01,656 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:01,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:01,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:01,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,657 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,659 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:01,659 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,661 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,661 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,661 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:01,661 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:01,661 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:01,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-16 06:02:01,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:02:01,662 DEBUG [(jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,661 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:01,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:02:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,662 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:01,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:01,762 DEBUG [Listener at localhost/42509] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:02:01,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:02:01,771 INFO [Listener at localhost/42509] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676527320809 type: FLUSH version: 2 ttl: 0 2023-02-16 06:02:01,771 DEBUG [Listener at localhost/42509] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6/data/default/testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,771 INFO [Listener at localhost/42509] snapshot.RestoreSnapshotHelper(239): region to add: 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:01,771 INFO [Listener at localhost/42509] snapshot.RestoreSnapshotHelper(585): clone region=567d0ac9bf0d761789ed9dbd733ae8c0 as 567d0ac9bf0d761789ed9dbd733ae8c0 in snapshot testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,772 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 567d0ac9bf0d761789ed9dbd733ae8c0, NAME => 'testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6 2023-02-16 06:02:01,778 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:01,778 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d79d29073104a7094b259e705ab43e3 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,780 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1491ac5d8bc47d5b6d619d290087855 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,782 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 567d0ac9bf0d761789ed9dbd733ae8c0, disabling compactions & flushes 2023-02-16 06:02:01,782 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,782 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,782 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. after waiting 0 ms 2023-02-16 06:02:01,782 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,782 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,782 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:01,782 INFO [Listener at localhost/42509] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676527320809 type: FLUSH version: 2 ttl: 0 2023-02-16 06:02:01,782 DEBUG [Listener at localhost/42509] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6 2023-02-16 06:02:01,782 DEBUG [Listener at localhost/42509] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6 2023-02-16 06:02:01,783 DEBUG [Listener at localhost/42509] util.CommonFSUtils(699): |-data/ 2023-02-16 06:02:01,783 DEBUG [Listener at localhost/42509] util.CommonFSUtils(699): |----default/ 2023-02-16 06:02:01,784 DEBUG [Listener at localhost/42509] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-16 06:02:01,784 DEBUG [Listener at localhost/42509] util.CommonFSUtils(699): |----------567d0ac9bf0d761789ed9dbd733ae8c0/ 2023-02-16 06:02:01,784 DEBUG [Listener at localhost/42509] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:02:01,785 DEBUG [Listener at localhost/42509] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:02:01,785 DEBUG [Listener at localhost/42509] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=567d0ac9bf0d761789ed9dbd733ae8c0-5d79d29073104a7094b259e705ab43e3 2023-02-16 06:02:01,785 DEBUG [Listener at localhost/42509] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:02:01,785 DEBUG [Listener at localhost/42509] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=567d0ac9bf0d761789ed9dbd733ae8c0-f1491ac5d8bc47d5b6d619d290087855 2023-02-16 06:02:01,788 INFO [Listener at localhost/42509] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 06:02:01,791 DEBUG [Listener at localhost/42509] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:01,791 INFO [Listener at localhost/42509] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:02:01,791 DEBUG [Listener at localhost/42509] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:02:01,793 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:01,794 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1 2023-02-16 06:02:01,794 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 567d0ac9bf0d761789ed9dbd733ae8c0 columnFamilyName f1 2023-02-16 06:02:01,797 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(539): loaded hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/testWithMockedMapReduceSingleRegion=567d0ac9bf0d761789ed9dbd733ae8c0-5d79d29073104a7094b259e705ab43e3 2023-02-16 06:02:01,798 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(310): Store=567d0ac9bf0d761789ed9dbd733ae8c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:01,798 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:01,798 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2 2023-02-16 06:02:01,798 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 567d0ac9bf0d761789ed9dbd733ae8c0 columnFamilyName f2 2023-02-16 06:02:01,802 DEBUG [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(539): loaded hdfs://localhost:41251/user/jenkins/test-data/6af47913-bccc-eb72-6945-8fe570c091c8/testWithMockedMapReduceSingleRegion/6742a080-11dd-46e5-94ed-e57a1f94fbd6/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/testWithMockedMapReduceSingleRegion=567d0ac9bf0d761789ed9dbd733ae8c0-f1491ac5d8bc47d5b6d619d290087855 2023-02-16 06:02:01,802 INFO [StoreOpener-567d0ac9bf0d761789ed9dbd733ae8c0-1] regionserver.HStore(310): Store=567d0ac9bf0d761789ed9dbd733ae8c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:01,802 DEBUG [Listener at localhost/42509] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:02:01,802 INFO [Listener at localhost/42509] regionserver.HRegion(1071): Opened 567d0ac9bf0d761789ed9dbd733ae8c0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73517383, jitterRate=0.09549437463283539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:02:01,802 DEBUG [Listener at localhost/42509] regionserver.HRegion(964): Region open journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:01,847 DEBUG [Listener at localhost/42509] regionserver.HRegion(1603): Closing 567d0ac9bf0d761789ed9dbd733ae8c0, disabling compactions & flushes 2023-02-16 06:02:01,847 INFO [Listener at localhost/42509] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,847 DEBUG [Listener at localhost/42509] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,847 DEBUG [Listener at localhost/42509] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. after waiting 0 ms 2023-02-16 06:02:01,847 DEBUG [Listener at localhost/42509] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,848 INFO [Listener at localhost/42509] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:01,848 DEBUG [Listener at localhost/42509] regionserver.HRegion(1557): Region close journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:01,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-16 06:02:01,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,855 INFO [Listener at localhost/42509] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:01,858 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527321858"}]},"ts":"1676527321858"} 2023-02-16 06:02:01,859 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-16 06:02:01,861 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-16 06:02:01,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, UNASSIGN}] 2023-02-16 06:02:01,863 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, UNASSIGN 2023-02-16 06:02:01,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=567d0ac9bf0d761789ed9dbd733ae8c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:01,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676527321863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527321863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527321863"}]},"ts":"1676527321863"} 2023-02-16 06:02:01,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 567d0ac9bf0d761789ed9dbd733ae8c0, server=jenkins-hbase4.apache.org,41877,1676527319009}] 2023-02-16 06:02:01,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:02,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:02,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 567d0ac9bf0d761789ed9dbd733ae8c0, disabling compactions & flushes 2023-02-16 06:02:02,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:02,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:02,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. after waiting 0 ms 2023-02-16 06:02:02,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:02,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:02:02,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0. 2023-02-16 06:02:02,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 567d0ac9bf0d761789ed9dbd733ae8c0: 2023-02-16 06:02:02,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:02,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=567d0ac9bf0d761789ed9dbd733ae8c0, regionState=CLOSED 2023-02-16 06:02:02,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676527322023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527322023"}]},"ts":"1676527322023"} 2023-02-16 06:02:02,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 06:02:02,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 567d0ac9bf0d761789ed9dbd733ae8c0, server=jenkins-hbase4.apache.org,41877,1676527319009 in 160 msec 2023-02-16 06:02:02,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 06:02:02,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=567d0ac9bf0d761789ed9dbd733ae8c0, UNASSIGN in 164 msec 2023-02-16 06:02:02,027 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527322027"}]},"ts":"1676527322027"} 2023-02-16 06:02:02,028 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-16 06:02:02,030 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-16 06:02:02,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 175 msec 2023-02-16 06:02:02,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:02,162 INFO [Listener at localhost/42509] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-16 06:02:02,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,165 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,166 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:02:02,168 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:02,170 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1, FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2, FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/recovered.edits] 2023-02-16 06:02:02,173 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/5d79d29073104a7094b259e705ab43e3 to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/archive/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/5d79d29073104a7094b259e705ab43e3 2023-02-16 06:02:02,174 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/6de60eb4c4394b799966ab2fe3c79823 to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/archive/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f1/6de60eb4c4394b799966ab2fe3c79823 2023-02-16 06:02:02,176 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/b503af29f57940cb853c4e88ee01e17e to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/archive/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/b503af29f57940cb853c4e88ee01e17e 2023-02-16 06:02:02,177 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/f1491ac5d8bc47d5b6d619d290087855 to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/archive/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/f2/f1491ac5d8bc47d5b6d619d290087855 2023-02-16 06:02:02,179 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/recovered.edits/12.seqid to hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/archive/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0/recovered.edits/12.seqid 2023-02-16 06:02:02,179 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/.tmp/data/default/testWithMockedMapReduceSingleRegion/567d0ac9bf0d761789ed9dbd733ae8c0 2023-02-16 06:02:02,179 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 06:02:02,181 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,182 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-16 06:02:02,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-16 06:02:02,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-16 06:02:02,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527322184"}]},"ts":"9223372036854775807"} 2023-02-16 06:02:02,186 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 06:02:02,186 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 567d0ac9bf0d761789ed9dbd733ae8c0, NAME => 'testWithMockedMapReduceSingleRegion,,1676527320066.567d0ac9bf0d761789ed9dbd733ae8c0.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 06:02:02,186 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-16 06:02:02,186 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676527322186"}]},"ts":"9223372036854775807"} 2023-02-16 06:02:02,187 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-16 06:02:02,188 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 06:02:02,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 25 msec 2023-02-16 06:02:02,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36461] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:02:02,268 INFO [Listener at localhost/42509] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-16 06:02:02,268 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:02:02,269 INFO [Listener at localhost/42509] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:02:02,270 DEBUG [Listener at localhost/42509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05c26623 to 127.0.0.1:51744 2023-02-16 06:02:02,270 DEBUG [Listener at localhost/42509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,270 DEBUG [Listener at localhost/42509] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:02:02,270 DEBUG [Listener at localhost/42509] util.JVMClusterUtil(257): Found active master hash=1507887115, stopped=false 2023-02-16 06:02:02,271 INFO [Listener at localhost/42509] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:02:02,273 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:02,273 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:02,273 INFO [Listener at localhost/42509] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:02:02,273 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:02,275 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:02,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:02,275 DEBUG [Listener at localhost/42509] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58185893 to 127.0.0.1:51744 2023-02-16 06:02:02,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:02,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:02,276 DEBUG [Listener at localhost/42509] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,276 INFO [Listener at localhost/42509] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41877,1676527319009' ***** 2023-02-16 06:02:02,276 INFO [Listener at localhost/42509] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:02:02,276 INFO [Listener at localhost/42509] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34823,1676527319033' ***** 2023-02-16 06:02:02,276 INFO [Listener at localhost/42509] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:02:02,277 INFO [RS:0;jenkins-hbase4:41877] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:02:02,277 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:02:02,277 INFO [RS:0;jenkins-hbase4:41877] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:02:02,278 INFO [RS:0;jenkins-hbase4:41877] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:02:02,278 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:02,278 DEBUG [RS:0;jenkins-hbase4:41877] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d172fcf to 127.0.0.1:51744 2023-02-16 06:02:02,278 DEBUG [RS:0;jenkins-hbase4:41877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,278 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41877,1676527319009; all regions closed. 2023-02-16 06:02:02,278 INFO [RS:1;jenkins-hbase4:34823] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:02:02,279 INFO [RS:1;jenkins-hbase4:34823] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:02:02,279 INFO [RS:1;jenkins-hbase4:34823] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:02:02,279 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(3304): Received CLOSE for c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:02:02,279 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:02:02,280 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:02,281 DEBUG [RS:1;jenkins-hbase4:34823] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x674397f2 to 127.0.0.1:51744 2023-02-16 06:02:02,281 DEBUG [RS:1;jenkins-hbase4:34823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7123a69f716f14573f631e2e2c3dcc5, disabling compactions & flushes 2023-02-16 06:02:02,281 INFO [RS:1;jenkins-hbase4:34823] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:02:02,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:02:02,281 INFO [RS:1;jenkins-hbase4:34823] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:02:02,281 INFO [RS:1;jenkins-hbase4:34823] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:02:02,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:02:02,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. after waiting 0 ms 2023-02-16 06:02:02,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:02:02,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c7123a69f716f14573f631e2e2c3dcc5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:02:02,281 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:02:02,282 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 06:02:02,282 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1479): Online Regions={c7123a69f716f14573f631e2e2c3dcc5=hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 06:02:02,282 DEBUG [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1505): Waiting on 1588230740, c7123a69f716f14573f631e2e2c3dcc5 2023-02-16 06:02:02,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:02:02,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:02:02,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:02:02,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:02:02,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:02:02,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-16 06:02:02,284 DEBUG [RS:0;jenkins-hbase4:41877] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/oldWALs 2023-02-16 06:02:02,284 INFO [RS:0;jenkins-hbase4:41877] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41877%2C1676527319009:(num 1676527320324) 2023-02-16 06:02:02,284 DEBUG [RS:0;jenkins-hbase4:41877] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,284 INFO [RS:0;jenkins-hbase4:41877] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:02,285 INFO [RS:0;jenkins-hbase4:41877] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 06:02:02,285 INFO [RS:0;jenkins-hbase4:41877] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:02:02,285 INFO [RS:0;jenkins-hbase4:41877] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:02:02,285 INFO [RS:0;jenkins-hbase4:41877] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:02:02,285 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:02,289 INFO [RS:0;jenkins-hbase4:41877] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41877 2023-02-16 06:02:02,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/.tmp/info/88a2fefb1e674327978c57fe7a5787f3 2023-02-16 06:02:02,296 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 06:02:02,296 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 06:02:02,299 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:02,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/.tmp/info/88a2fefb1e674327978c57fe7a5787f3 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/info/88a2fefb1e674327978c57fe7a5787f3 2023-02-16 06:02:02,301 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:02,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/info/88a2fefb1e674327978c57fe7a5787f3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:02:02,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c7123a69f716f14573f631e2e2c3dcc5 in 25ms, sequenceid=6, compaction requested=false 2023-02-16 06:02:02,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/.tmp/info/19aa04c363014ae19e317a91d1ff0690 2023-02-16 06:02:02,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/namespace/c7123a69f716f14573f631e2e2c3dcc5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:02:02,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:02:02,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7123a69f716f14573f631e2e2c3dcc5: 2023-02-16 06:02:02,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527319573.c7123a69f716f14573f631e2e2c3dcc5. 2023-02-16 06:02:02,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19aa04c363014ae19e317a91d1ff0690 2023-02-16 06:02:02,318 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/.tmp/rep_barrier/02004ad2c15c4aaa94f901bbce321981 2023-02-16 06:02:02,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02004ad2c15c4aaa94f901bbce321981 2023-02-16 06:02:02,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/.tmp/table/290233a88f1847d7b1eb5958dbf17bc1 2023-02-16 06:02:02,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 290233a88f1847d7b1eb5958dbf17bc1 2023-02-16 06:02:02,331 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/.tmp/info/19aa04c363014ae19e317a91d1ff0690 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/info/19aa04c363014ae19e317a91d1ff0690 2023-02-16 06:02:02,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19aa04c363014ae19e317a91d1ff0690 2023-02-16 06:02:02,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/info/19aa04c363014ae19e317a91d1ff0690, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 06:02:02,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/.tmp/rep_barrier/02004ad2c15c4aaa94f901bbce321981 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/rep_barrier/02004ad2c15c4aaa94f901bbce321981 2023-02-16 06:02:02,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02004ad2c15c4aaa94f901bbce321981 2023-02-16 06:02:02,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/rep_barrier/02004ad2c15c4aaa94f901bbce321981, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 06:02:02,340 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/.tmp/table/290233a88f1847d7b1eb5958dbf17bc1 as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/table/290233a88f1847d7b1eb5958dbf17bc1 2023-02-16 06:02:02,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 290233a88f1847d7b1eb5958dbf17bc1 2023-02-16 06:02:02,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/table/290233a88f1847d7b1eb5958dbf17bc1, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 06:02:02,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=21, compaction requested=false 2023-02-16 06:02:02,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 06:02:02,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:02:02,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:02,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:02:02,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:02,382 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:02,382 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:02,382 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@171ad555 rejected from java.util.concurrent.ThreadPoolExecutor@1325536e[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,382 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41877,1676527319009 2023-02-16 06:02:02,382 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:02,382 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:02,382 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@264a007c rejected from java.util.concurrent.ThreadPoolExecutor@1325536e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,384 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41877,1676527319009] 2023-02-16 06:02:02,384 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41877,1676527319009; numProcessing=1 2023-02-16 06:02:02,385 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41877,1676527319009 already deleted, retry=false 2023-02-16 06:02:02,386 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41877,1676527319009 expired; onlineServers=1 2023-02-16 06:02:02,473 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:02:02,482 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34823,1676527319033; all regions closed. 2023-02-16 06:02:02,488 DEBUG [RS:1;jenkins-hbase4:34823] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/oldWALs 2023-02-16 06:02:02,488 INFO [RS:1;jenkins-hbase4:34823] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34823%2C1676527319033.meta:.meta(num 1676527319524) 2023-02-16 06:02:02,492 DEBUG [RS:1;jenkins-hbase4:34823] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/oldWALs 2023-02-16 06:02:02,492 INFO [RS:1;jenkins-hbase4:34823] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34823%2C1676527319033:(num 1676527319913) 2023-02-16 06:02:02,492 DEBUG [RS:1;jenkins-hbase4:34823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,492 INFO [RS:1;jenkins-hbase4:34823] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:02,493 INFO [RS:1;jenkins-hbase4:34823] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:02:02,493 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:02,494 INFO [RS:1;jenkins-hbase4:34823] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34823 2023-02-16 06:02:02,496 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34823,1676527319033 2023-02-16 06:02:02,496 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:02,496 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5cfe950e rejected from java.util.concurrent.ThreadPoolExecutor@58c10a49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,498 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34823,1676527319033] 2023-02-16 06:02:02,498 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34823,1676527319033; numProcessing=2 2023-02-16 06:02:02,499 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34823,1676527319033 already deleted, retry=false 2023-02-16 06:02:02,499 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34823,1676527319033 expired; onlineServers=0 2023-02-16 06:02:02,499 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36461,1676527318959' ***** 2023-02-16 06:02:02,499 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:02:02,500 DEBUG [M:0;jenkins-hbase4:36461] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ddf17ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:02,500 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36461,1676527318959 2023-02-16 06:02:02,500 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36461,1676527318959; all regions closed. 2023-02-16 06:02:02,500 DEBUG [M:0;jenkins-hbase4:36461] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:02,501 DEBUG [M:0;jenkins-hbase4:36461] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:02:02,501 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:02:02,501 DEBUG [M:0;jenkins-hbase4:36461] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:02:02,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527319164] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527319164,5,FailOnTimeoutGroup] 2023-02-16 06:02:02,501 INFO [M:0;jenkins-hbase4:36461] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:02:02,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527319164] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527319164,5,FailOnTimeoutGroup] 2023-02-16 06:02:02,501 INFO [M:0;jenkins-hbase4:36461] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:02:02,502 INFO [M:0;jenkins-hbase4:36461] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:02:02,502 DEBUG [M:0;jenkins-hbase4:36461] master.HMaster(1512): Stopping service threads 2023-02-16 06:02:02,502 INFO [M:0;jenkins-hbase4:36461] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:02:02,502 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:02,503 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:02,503 ERROR [M:0;jenkins-hbase4:36461] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:02:02,503 INFO [M:0;jenkins-hbase4:36461] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:02:02,503 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:02:02,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:02,503 DEBUG [M:0;jenkins-hbase4:36461] zookeeper.ZKUtil(398): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 06:02:02,503 WARN [M:0;jenkins-hbase4:36461] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 06:02:02,503 INFO [M:0;jenkins-hbase4:36461] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:02:02,504 INFO [M:0;jenkins-hbase4:36461] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:02:02,504 DEBUG [M:0;jenkins-hbase4:36461] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:02:02,504 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:02,504 DEBUG [M:0;jenkins-hbase4:36461] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:02,504 DEBUG [M:0;jenkins-hbase4:36461] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:02:02,504 DEBUG [M:0;jenkins-hbase4:36461] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:02,504 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.10 KB heapSize=67.06 KB 2023-02-16 06:02:02,518 INFO [M:0;jenkins-hbase4:36461] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.10 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c2327192a54349c0963f4b005177b6ed 2023-02-16 06:02:02,524 DEBUG [M:0;jenkins-hbase4:36461] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c2327192a54349c0963f4b005177b6ed as hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c2327192a54349c0963f4b005177b6ed 2023-02-16 06:02:02,528 INFO [M:0;jenkins-hbase4:36461] regionserver.HStore(1080): Added hdfs://localhost:41251/user/jenkins/test-data/2e282388-2676-c5dd-df5d-a3b27c7f17fb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c2327192a54349c0963f4b005177b6ed, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 06:02:02,528 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegion(2947): Finished flush of dataSize ~56.10 KB/57451, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false 2023-02-16 06:02:02,529 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:02,530 DEBUG [M:0;jenkins-hbase4:36461] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:02,532 INFO [M:0;jenkins-hbase4:36461] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:02:02,532 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:02,533 INFO [M:0;jenkins-hbase4:36461] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36461 2023-02-16 06:02:02,536 DEBUG [M:0;jenkins-hbase4:36461] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36461,1676527318959 already deleted, retry=false 2023-02-16 06:02:02,574 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:02,574 INFO [RS:0;jenkins-hbase4:41877] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41877,1676527319009; zookeeper connection closed. 2023-02-16 06:02:02,574 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ebc4837 rejected from java.util.concurrent.ThreadPoolExecutor@1325536e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,574 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d189060] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d189060 2023-02-16 06:02:02,574 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:41877-0x1005bb8a1610001, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:02,575 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40379f7c rejected from java.util.concurrent.ThreadPoolExecutor@1325536e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,775 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:02,775 INFO [M:0;jenkins-hbase4:36461] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36461,1676527318959; zookeeper connection closed. 2023-02-16 06:02:02,775 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ebe465e rejected from java.util.concurrent.ThreadPoolExecutor@4a81db51[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,776 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): master:36461-0x1005bb8a1610000, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:02,776 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f61d0c rejected from java.util.concurrent.ThreadPoolExecutor@4a81db51[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,875 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:02,875 INFO [RS:1;jenkins-hbase4:34823] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34823,1676527319033; zookeeper connection closed. 2023-02-16 06:02:02,875 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46a151d rejected from java.util.concurrent.ThreadPoolExecutor@58c10a49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,875 DEBUG [Listener at localhost/42509-EventThread] zookeeper.ZKWatcher(600): regionserver:34823-0x1005bb8a1610002, quorum=127.0.0.1:51744, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:02,875 ERROR [Listener at localhost/42509-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c5772f2 rejected from java.util.concurrent.ThreadPoolExecutor@58c10a49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:02,875 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@480235b6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@480235b6 2023-02-16 06:02:02,876 INFO [Listener at localhost/42509] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:02:02,876 WARN [Listener at localhost/42509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:02:02,879 INFO [Listener at localhost/42509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:02,984 WARN [BP-333961380-172.31.14.131-1676527318273 heartbeating to localhost/127.0.0.1:41251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:02:02,984 WARN [BP-333961380-172.31.14.131-1676527318273 heartbeating to localhost/127.0.0.1:41251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-333961380-172.31.14.131-1676527318273 (Datanode Uuid d7d5d5a4-bdef-440e-a2f5-e10ec416b0dd) service to localhost/127.0.0.1:41251 2023-02-16 06:02:02,985 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/dfs/data/data3/current/BP-333961380-172.31.14.131-1676527318273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:02,985 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/dfs/data/data4/current/BP-333961380-172.31.14.131-1676527318273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:02,986 WARN [Listener at localhost/42509] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:02:02,989 INFO [Listener at localhost/42509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:03,092 WARN [BP-333961380-172.31.14.131-1676527318273 heartbeating to localhost/127.0.0.1:41251] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:02:03,092 WARN [BP-333961380-172.31.14.131-1676527318273 heartbeating to localhost/127.0.0.1:41251] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-333961380-172.31.14.131-1676527318273 (Datanode Uuid 0c969903-08da-4c3c-857d-5bbede503727) service to localhost/127.0.0.1:41251 2023-02-16 06:02:03,093 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/dfs/data/data1/current/BP-333961380-172.31.14.131-1676527318273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:03,093 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/cluster_15cc4d9e-7f8e-0d71-2b2d-b6f025525883/dfs/data/data2/current/BP-333961380-172.31.14.131-1676527318273] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:03,104 INFO [Listener at localhost/42509] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:03,217 INFO [Listener at localhost/42509] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:02:03,231 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:02:03,243 INFO [Listener at localhost/42509] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 228) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:41251 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:41251 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36461,1676527318959)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41251 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42509 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41251 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/42509.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41251 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41251 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:41251 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=662 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=325 (was 310) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1750 (was 1801) 2023-02-16 06:02:03,254 INFO [Listener at localhost/42509] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=662, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=168, AvailableMemoryMB=1750 2023-02-16 06:02:03,264 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/hadoop.log.dir so I do NOT create it in target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b 2023-02-16 06:02:03,265 WARN [Listener at localhost/42509] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/hadoop.tmp.dir so I do NOT create it in target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b 2023-02-16 06:02:03,265 WARN [Listener at localhost/42509] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c95fb6a7-5344-20fb-4a8a-a3a07c1cd91c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 06:02:03,265 DEBUG [Listener at localhost/42509] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173, deleteOnExit=true 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/test.cache.data in system properties and HBase conf 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:02:03,265 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:02:03,266 DEBUG [Listener at localhost/42509] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:02:03,266 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:02:03,267 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:02:03,267 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:02:03,267 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:02:03,267 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:02:03,267 INFO [Listener at localhost/42509] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:02:03,271 WARN [Listener at localhost/42509] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:02:03,271 WARN [Listener at localhost/42509] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:02:03,311 WARN [Listener at localhost/42509] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:02:03,313 INFO [Listener at localhost/42509] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:02:03,320 INFO [Listener at localhost/42509] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/java.io.tmpdir/Jetty_localhost_37147_hdfs____phb5tm/webapp 2023-02-16 06:02:03,418 INFO [Listener at localhost/42509] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37147 2023-02-16 06:02:03,422 WARN [Listener at localhost/42509] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:02:03,422 WARN [Listener at localhost/42509] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:02:03,463 WARN [Listener at localhost/40939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:02:03,473 WARN [Listener at localhost/40939] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:02:03,475 WARN [Listener at localhost/40939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:02:03,476 INFO [Listener at localhost/40939] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:02:03,483 INFO [Listener at localhost/40939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/java.io.tmpdir/Jetty_localhost_41911_datanode____2s2ctf/webapp 2023-02-16 06:02:03,576 INFO [Listener at localhost/40939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41911 2023-02-16 06:02:03,583 WARN [Listener at localhost/33561] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:02:03,595 WARN [Listener at localhost/33561] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:02:03,597 WARN [Listener at localhost/33561] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:02:03,598 INFO [Listener at localhost/33561] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:02:03,604 INFO [Listener at localhost/33561] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/java.io.tmpdir/Jetty_localhost_45757_datanode____.1cr481/webapp 2023-02-16 06:02:03,768 INFO [Listener at localhost/33561] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45757 2023-02-16 06:02:03,799 WARN [Listener at localhost/45817] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:02:03,799 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x705fc669e8c75f65: Processing first storage report for DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2 from datanode cb1d3a48-7b23-4afc-9a4b-ee96c48fd0a3 2023-02-16 06:02:03,799 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x705fc669e8c75f65: from storage DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2 node DatanodeRegistration(127.0.0.1:34597, datanodeUuid=cb1d3a48-7b23-4afc-9a4b-ee96c48fd0a3, infoPort=39205, infoSecurePort=0, ipcPort=33561, storageInfo=lv=-57;cid=testClusterID;nsid=1039957006;c=1676527323274), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:03,799 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x705fc669e8c75f65: Processing first storage report for DS-0c8c78b3-a0b5-4495-a33b-bf4d977a8d10 from datanode cb1d3a48-7b23-4afc-9a4b-ee96c48fd0a3 2023-02-16 06:02:03,799 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x705fc669e8c75f65: from storage DS-0c8c78b3-a0b5-4495-a33b-bf4d977a8d10 node DatanodeRegistration(127.0.0.1:34597, datanodeUuid=cb1d3a48-7b23-4afc-9a4b-ee96c48fd0a3, infoPort=39205, infoSecurePort=0, ipcPort=33561, storageInfo=lv=-57;cid=testClusterID;nsid=1039957006;c=1676527323274), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:03,923 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb91ca6c6c8dfbaf: Processing first storage report for DS-d8d8ec83-2375-44a0-98bb-6096c167ad23 from datanode 9ad17df2-7849-4bbc-a8ac-a56d98e1dfaa 2023-02-16 06:02:03,923 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb91ca6c6c8dfbaf: from storage DS-d8d8ec83-2375-44a0-98bb-6096c167ad23 node DatanodeRegistration(127.0.0.1:41009, datanodeUuid=9ad17df2-7849-4bbc-a8ac-a56d98e1dfaa, infoPort=45773, infoSecurePort=0, ipcPort=45817, storageInfo=lv=-57;cid=testClusterID;nsid=1039957006;c=1676527323274), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:03,923 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb91ca6c6c8dfbaf: Processing first storage report for DS-655e51f5-8a75-4ac4-af20-ac045c08ad29 from datanode 9ad17df2-7849-4bbc-a8ac-a56d98e1dfaa 2023-02-16 06:02:03,923 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb91ca6c6c8dfbaf: from storage DS-655e51f5-8a75-4ac4-af20-ac045c08ad29 node DatanodeRegistration(127.0.0.1:41009, datanodeUuid=9ad17df2-7849-4bbc-a8ac-a56d98e1dfaa, infoPort=45773, infoSecurePort=0, ipcPort=45817, storageInfo=lv=-57;cid=testClusterID;nsid=1039957006;c=1676527323274), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:04,017 DEBUG [Listener at localhost/45817] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b 2023-02-16 06:02:04,024 INFO [Listener at localhost/45817] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/zookeeper_0, clientPort=54484, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:02:04,025 INFO [Listener at localhost/45817] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54484 2023-02-16 06:02:04,025 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,026 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,060 INFO [Listener at localhost/45817] util.FSUtils(479): Created version file at hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d with version=8 2023-02-16 06:02:04,060 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,061 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,062 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40939/user/jenkins/test-data/c317f254-0439-ca36-b2bf-1928e054cba8/hbase-staging 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:02:04,065 INFO [Listener at localhost/45817] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:02:04,067 INFO [Listener at localhost/45817] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39287 2023-02-16 06:02:04,067 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,068 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,069 INFO [Listener at localhost/45817] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39287 connecting to ZooKeeper ensemble=127.0.0.1:54484 2023-02-16 06:02:04,078 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:392870x0, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:02:04,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39287-0x1005bb8b5380000 connected 2023-02-16 06:02:04,109 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:04,110 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:04,110 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:02:04,114 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39287 2023-02-16 06:02:04,115 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39287 2023-02-16 06:02:04,115 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39287 2023-02-16 06:02:04,116 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39287 2023-02-16 06:02:04,119 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39287 2023-02-16 06:02:04,119 INFO [Listener at localhost/45817] master.HMaster(444): hbase.rootdir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d, hbase.cluster.distributed=false 2023-02-16 06:02:04,131 INFO [Listener at localhost/45817] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:02:04,132 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,132 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,132 INFO [Listener at localhost/45817] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:02:04,132 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,132 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:02:04,132 INFO [Listener at localhost/45817] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:02:04,133 INFO [Listener at localhost/45817] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34343 2023-02-16 06:02:04,133 INFO [Listener at localhost/45817] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:02:04,133 DEBUG [Listener at localhost/45817] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:02:04,134 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,135 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,136 INFO [Listener at localhost/45817] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34343 connecting to ZooKeeper ensemble=127.0.0.1:54484 2023-02-16 06:02:04,138 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:343430x0, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:02:04,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34343-0x1005bb8b5380001 connected 2023-02-16 06:02:04,139 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:04,139 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:04,140 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:02:04,144 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34343 2023-02-16 06:02:04,144 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34343 2023-02-16 06:02:04,144 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34343 2023-02-16 06:02:04,145 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34343 2023-02-16 06:02:04,148 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34343 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:02:04,159 INFO [Listener at localhost/45817] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:02:04,160 INFO [Listener at localhost/45817] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35513 2023-02-16 06:02:04,160 INFO [Listener at localhost/45817] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:02:04,161 DEBUG [Listener at localhost/45817] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:02:04,161 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,162 INFO [Listener at localhost/45817] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,164 INFO [Listener at localhost/45817] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35513 connecting to ZooKeeper ensemble=127.0.0.1:54484 2023-02-16 06:02:04,168 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:355130x0, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:02:04,169 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): regionserver:355130x0, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:04,170 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): regionserver:355130x0, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:04,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35513-0x1005bb8b5380002 connected 2023-02-16 06:02:04,172 DEBUG [Listener at localhost/45817] zookeeper.ZKUtil(164): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:02:04,184 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35513 2023-02-16 06:02:04,184 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35513 2023-02-16 06:02:04,184 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35513 2023-02-16 06:02:04,188 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35513 2023-02-16 06:02:04,188 DEBUG [Listener at localhost/45817] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35513 2023-02-16 06:02:04,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,193 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:02:04,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,194 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:04,194 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:04,194 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:04,195 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:02:04,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39287,1676527324064 from backup master directory 2023-02-16 06:02:04,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:02:04,200 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,200 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:02:04,200 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:02:04,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/hbase.id with ID: 9a2c47c4-2907-4382-8d7f-c3546367ed7c 2023-02-16 06:02:04,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:04,229 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c574a2a to 127.0.0.1:54484 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:04,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12739897, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:04,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:04,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:02:04,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:04,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store-tmp 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:02:04,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:04,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:04,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/WALs/jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39287%2C1676527324064, suffix=, logDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/WALs/jenkins-hbase4.apache.org,39287,1676527324064, archiveDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/oldWALs, maxLogs=10 2023-02-16 06:02:04,269 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK] 2023-02-16 06:02:04,269 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK] 2023-02-16 06:02:04,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/WALs/jenkins-hbase4.apache.org,39287,1676527324064/jenkins-hbase4.apache.org%2C39287%2C1676527324064.1676527324256 2023-02-16 06:02:04,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK]] 2023-02-16 06:02:04,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:04,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:04,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:04,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:04,272 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:04,273 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:02:04,273 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:02:04,274 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:04,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:04,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:04,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:04,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69242865, jitterRate=0.03179909288883209}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:02:04,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:04,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:02:04,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:02:04,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:02:04,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:02:04,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 06:02:04,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 06:02:04,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:02:04,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:02:04,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:02:04,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:02:04,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:02:04,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:02:04,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:02:04,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:02:04,297 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:02:04,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:02:04,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:02:04,300 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:04,300 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:04,300 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:04,300 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39287,1676527324064, sessionid=0x1005bb8b5380000, setting cluster-up flag (Was=false) 2023-02-16 06:02:04,306 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:02:04,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,314 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:02:04,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:04,321 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.hbase-snapshot/.tmp 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:02:04,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527354325 2023-02-16 06:02:04,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:02:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:02:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:02:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:02:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:02:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:02:04,326 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:02:04,326 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:02:04,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:02:04,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:02:04,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:02:04,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:02:04,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:02:04,327 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:04,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527324327,5,FailOnTimeoutGroup] 2023-02-16 06:02:04,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527324327,5,FailOnTimeoutGroup] 2023-02-16 06:02:04,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:02:04,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,335 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:04,336 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:04,336 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d 2023-02-16 06:02:04,343 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:04,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:02:04,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/info 2023-02-16 06:02:04,345 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:02:04,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:02:04,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:02:04,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:02:04,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:02:04,349 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/table 2023-02-16 06:02:04,349 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:02:04,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,350 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740 2023-02-16 06:02:04,350 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740 2023-02-16 06:02:04,352 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:02:04,353 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:02:04,355 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:04,356 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64946392, jitterRate=-0.03222334384918213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:02:04,356 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:02:04,356 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:02:04,356 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:02:04,356 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:02:04,356 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:02:04,356 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:02:04,357 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:04,357 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:02:04,357 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:02:04,357 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:02:04,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:02:04,360 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:02:04,361 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:02:04,391 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(952): ClusterId : 9a2c47c4-2907-4382-8d7f-c3546367ed7c 2023-02-16 06:02:04,391 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:02:04,391 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(952): ClusterId : 9a2c47c4-2907-4382-8d7f-c3546367ed7c 2023-02-16 06:02:04,391 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:02:04,393 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:02:04,393 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:02:04,393 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:02:04,393 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:02:04,396 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:02:04,397 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:02:04,398 DEBUG [RS:0;jenkins-hbase4:34343] zookeeper.ReadOnlyZKClient(139): Connect 0x32f141a5 to 127.0.0.1:54484 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:04,398 DEBUG [RS:1;jenkins-hbase4:35513] zookeeper.ReadOnlyZKClient(139): Connect 0x62263600 to 127.0.0.1:54484 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:04,401 DEBUG [RS:1;jenkins-hbase4:35513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ce1c434, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:04,401 DEBUG [RS:1;jenkins-hbase4:35513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68de5d70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:04,402 DEBUG [RS:0;jenkins-hbase4:34343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c36b98b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:04,402 DEBUG [RS:0;jenkins-hbase4:34343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38092ad5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:04,415 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34343 2023-02-16 06:02:04,415 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35513 2023-02-16 06:02:04,415 INFO [RS:0;jenkins-hbase4:34343] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:02:04,415 INFO [RS:0;jenkins-hbase4:34343] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:02:04,415 INFO [RS:1;jenkins-hbase4:35513] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:02:04,415 INFO [RS:1;jenkins-hbase4:35513] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:02:04,415 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:02:04,415 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:02:04,416 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39287,1676527324064 with isa=jenkins-hbase4.apache.org/172.31.14.131:34343, startcode=1676527324131 2023-02-16 06:02:04,416 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39287,1676527324064 with isa=jenkins-hbase4.apache.org/172.31.14.131:35513, startcode=1676527324158 2023-02-16 06:02:04,416 DEBUG [RS:1;jenkins-hbase4:35513] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:02:04,416 DEBUG [RS:0;jenkins-hbase4:34343] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:02:04,418 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56521, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:02:04,418 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45429, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:02:04,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39287] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,421 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d 2023-02-16 06:02:04,421 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40939 2023-02-16 06:02:04,421 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:02:04,421 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d 2023-02-16 06:02:04,421 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40939 2023-02-16 06:02:04,422 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:02:04,423 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:04,423 DEBUG [RS:0;jenkins-hbase4:34343] zookeeper.ZKUtil(162): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,423 WARN [RS:0;jenkins-hbase4:34343] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:02:04,423 INFO [RS:0;jenkins-hbase4:34343] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:04,423 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,430 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34343,1676527324131] 2023-02-16 06:02:04,430 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35513,1676527324158] 2023-02-16 06:02:04,430 DEBUG [RS:1;jenkins-hbase4:35513] zookeeper.ZKUtil(162): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,430 WARN [RS:1;jenkins-hbase4:35513] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:02:04,431 INFO [RS:1;jenkins-hbase4:35513] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:04,431 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,437 DEBUG [RS:0;jenkins-hbase4:34343] zookeeper.ZKUtil(162): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,437 DEBUG [RS:1;jenkins-hbase4:35513] zookeeper.ZKUtil(162): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,437 DEBUG [RS:0;jenkins-hbase4:34343] zookeeper.ZKUtil(162): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,437 DEBUG [RS:1;jenkins-hbase4:35513] zookeeper.ZKUtil(162): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,438 DEBUG [RS:1;jenkins-hbase4:35513] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:02:04,438 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:02:04,438 INFO [RS:1;jenkins-hbase4:35513] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:02:04,438 INFO [RS:0;jenkins-hbase4:34343] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:02:04,439 INFO [RS:1;jenkins-hbase4:35513] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:02:04,441 INFO [RS:1;jenkins-hbase4:35513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:02:04,441 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,444 INFO [RS:0;jenkins-hbase4:34343] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:02:04,444 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:02:04,445 INFO [RS:0;jenkins-hbase4:34343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:02:04,445 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,445 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:02:04,446 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,446 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,446 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,446 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,446 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,446 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:02:04,447 DEBUG [RS:1;jenkins-hbase4:35513] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,447 DEBUG [RS:0;jenkins-hbase4:34343] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:04,448 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,449 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,449 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,451 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,451 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,451 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,462 INFO [RS:0;jenkins-hbase4:34343] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:02:04,462 INFO [RS:1;jenkins-hbase4:35513] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:02:04,462 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34343,1676527324131-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,462 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35513,1676527324158-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,473 INFO [RS:0;jenkins-hbase4:34343] regionserver.Replication(203): jenkins-hbase4.apache.org,34343,1676527324131 started 2023-02-16 06:02:04,473 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34343,1676527324131, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34343, sessionid=0x1005bb8b5380001 2023-02-16 06:02:04,473 INFO [RS:1;jenkins-hbase4:35513] regionserver.Replication(203): jenkins-hbase4.apache.org,35513,1676527324158 started 2023-02-16 06:02:04,474 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:02:04,474 DEBUG [RS:0;jenkins-hbase4:34343] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,474 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35513,1676527324158, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35513, sessionid=0x1005bb8b5380002 2023-02-16 06:02:04,474 DEBUG [RS:0;jenkins-hbase4:34343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34343,1676527324131' 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35513,1676527324158' 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:04,474 DEBUG [RS:0;jenkins-hbase4:34343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:04,474 DEBUG [RS:0;jenkins-hbase4:34343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:02:04,474 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:02:04,475 DEBUG [RS:1;jenkins-hbase4:35513] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34343,1676527324131' 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:04,475 DEBUG [RS:1;jenkins-hbase4:35513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35513,1676527324158' 2023-02-16 06:02:04,475 DEBUG [RS:1;jenkins-hbase4:35513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:04,475 DEBUG [RS:1;jenkins-hbase4:35513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:04,475 DEBUG [RS:0;jenkins-hbase4:34343] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:02:04,475 INFO [RS:0;jenkins-hbase4:34343] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:02:04,475 INFO [RS:0;jenkins-hbase4:34343] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:02:04,475 DEBUG [RS:1;jenkins-hbase4:35513] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:02:04,475 INFO [RS:1;jenkins-hbase4:35513] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:02:04,475 INFO [RS:1;jenkins-hbase4:35513] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:02:04,511 DEBUG [jenkins-hbase4:39287] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:02:04,511 DEBUG [jenkins-hbase4:39287] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:04,513 DEBUG [jenkins-hbase4:39287] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:04,513 DEBUG [jenkins-hbase4:39287] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:04,513 DEBUG [jenkins-hbase4:39287] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:04,513 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34343,1676527324131, state=OPENING 2023-02-16 06:02:04,514 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:02:04,515 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:04,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34343,1676527324131}] 2023-02-16 06:02:04,516 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:02:04,670 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,670 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:02:04,672 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:02:04,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:02:04,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:04,677 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34343%2C1676527324131.meta, suffix=.meta, logDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,34343,1676527324131, archiveDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/oldWALs, maxLogs=32 2023-02-16 06:02:04,690 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK] 2023-02-16 06:02:04,691 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK] 2023-02-16 06:02:04,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,34343,1676527324131/jenkins-hbase4.apache.org%2C34343%2C1676527324131.meta.1676527324677.meta 2023-02-16 06:02:04,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK], DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK]] 2023-02-16 06:02:04,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:04,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:02:04,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:02:04,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:02:04,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:02:04,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:04,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:02:04,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:02:04,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:02:04,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/info 2023-02-16 06:02:04,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/info 2023-02-16 06:02:04,695 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:02:04,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:02:04,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:02:04,696 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:02:04,697 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:02:04,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:02:04,697 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/table 2023-02-16 06:02:04,698 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/table 2023-02-16 06:02:04,698 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:02:04,698 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:04,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740 2023-02-16 06:02:04,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740 2023-02-16 06:02:04,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:02:04,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:02:04,702 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71157029, jitterRate=0.0603223592042923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:02:04,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:02:04,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527324670 2023-02-16 06:02:04,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:02:04,710 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:02:04,710 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34343,1676527324131, state=OPEN 2023-02-16 06:02:04,711 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:02:04,711 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:02:04,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:02:04,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34343,1676527324131 in 195 msec 2023-02-16 06:02:04,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:02:04,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-16 06:02:04,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-16 06:02:04,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527324714, completionTime=-1 2023-02-16 06:02:04,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:02:04,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:02:04,715 DEBUG [hconnection-0x6edbfad5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:04,717 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37622, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:04,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:02:04,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527384718 2023-02-16 06:02:04,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527444718 2023-02-16 06:02:04,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 3 msec 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39287,1676527324064-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39287,1676527324064-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39287,1676527324064-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39287, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:02:04,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:04,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:02:04,730 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:02:04,730 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:02:04,731 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:02:04,732 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:04,732 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c empty. 2023-02-16 06:02:04,733 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:04,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:02:04,740 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:04,741 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9bfed524a1b81229b0feb01bc5621c5c, NAME => 'hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp 2023-02-16 06:02:04,746 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:04,746 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 9bfed524a1b81229b0feb01bc5621c5c, disabling compactions & flushes 2023-02-16 06:02:04,746 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:04,746 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:04,746 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. after waiting 0 ms 2023-02-16 06:02:04,746 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:04,746 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:04,746 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 9bfed524a1b81229b0feb01bc5621c5c: 2023-02-16 06:02:04,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:02:04,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527324749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527324749"}]},"ts":"1676527324749"} 2023-02-16 06:02:04,750 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:02:04,751 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:02:04,751 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527324751"}]},"ts":"1676527324751"} 2023-02-16 06:02:04,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:02:04,754 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:04,755 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:04,755 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:04,755 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:04,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9bfed524a1b81229b0feb01bc5621c5c, ASSIGN}] 2023-02-16 06:02:04,757 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9bfed524a1b81229b0feb01bc5621c5c, ASSIGN 2023-02-16 06:02:04,758 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9bfed524a1b81229b0feb01bc5621c5c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34343,1676527324131; forceNewPlan=false, retain=false 2023-02-16 06:02:04,908 INFO [jenkins-hbase4:39287] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:02:04,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9bfed524a1b81229b0feb01bc5621c5c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:04,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527324908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527324908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527324908"}]},"ts":"1676527324908"} 2023-02-16 06:02:04,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9bfed524a1b81229b0feb01bc5621c5c, server=jenkins-hbase4.apache.org,34343,1676527324131}] 2023-02-16 06:02:05,065 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:05,066 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34343%2C1676527324131, suffix=, logDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,34343,1676527324131, archiveDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/oldWALs, maxLogs=32 2023-02-16 06:02:05,082 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK] 2023-02-16 06:02:05,082 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK] 2023-02-16 06:02:05,100 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,34343,1676527324131/jenkins-hbase4.apache.org%2C34343%2C1676527324131.1676527325067 2023-02-16 06:02:05,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK], DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK]] 2023-02-16 06:02:05,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9bfed524a1b81229b0feb01bc5621c5c, NAME => 'hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:05,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:05,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,102 INFO [StoreOpener-9bfed524a1b81229b0feb01bc5621c5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,104 DEBUG [StoreOpener-9bfed524a1b81229b0feb01bc5621c5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/info 2023-02-16 06:02:05,104 DEBUG [StoreOpener-9bfed524a1b81229b0feb01bc5621c5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/info 2023-02-16 06:02:05,104 INFO [StoreOpener-9bfed524a1b81229b0feb01bc5621c5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bfed524a1b81229b0feb01bc5621c5c columnFamilyName info 2023-02-16 06:02:05,105 INFO [StoreOpener-9bfed524a1b81229b0feb01bc5621c5c-1] regionserver.HStore(310): Store=9bfed524a1b81229b0feb01bc5621c5c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:05,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:05,110 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:05,111 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9bfed524a1b81229b0feb01bc5621c5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66340051, jitterRate=-0.011456206440925598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:02:05,111 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9bfed524a1b81229b0feb01bc5621c5c: 2023-02-16 06:02:05,112 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c., pid=6, masterSystemTime=1676527325062 2023-02-16 06:02:05,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:05,115 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:05,115 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9bfed524a1b81229b0feb01bc5621c5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:05,115 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527325115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527325115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527325115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527325115"}]},"ts":"1676527325115"} 2023-02-16 06:02:05,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:02:05,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9bfed524a1b81229b0feb01bc5621c5c, server=jenkins-hbase4.apache.org,34343,1676527324131 in 206 msec 2023-02-16 06:02:05,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:02:05,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9bfed524a1b81229b0feb01bc5621c5c, ASSIGN in 362 msec 2023-02-16 06:02:05,119 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:02:05,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527325119"}]},"ts":"1676527325119"} 2023-02-16 06:02:05,120 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:02:05,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:02:05,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 394 msec 2023-02-16 06:02:05,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:02:05,131 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:05,131 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:05,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:02:05,141 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:05,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-16 06:02:05,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:02:05,151 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:05,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 06:02:05,159 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:02:05,161 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:02:05,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.961sec 2023-02-16 06:02:05,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:02:05,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:02:05,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:02:05,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39287,1676527324064-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:02:05,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39287,1676527324064-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:02:05,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:02:05,191 DEBUG [Listener at localhost/45817] zookeeper.ReadOnlyZKClient(139): Connect 0x1dcefd95 to 127.0.0.1:54484 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:05,199 DEBUG [Listener at localhost/45817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63de8b39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:05,202 DEBUG [hconnection-0x7a6eea58-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:05,205 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:05,207 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:05,207 DEBUG [Listener at localhost/45817] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:02:05,210 DEBUG [Listener at localhost/45817] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:02:05,212 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:02:05,213 INFO [Listener at localhost/45817] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:05,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:05,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:02:05,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:59998 deadline: 1676527385213, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:05,214 INFO [Listener at localhost/45817] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 06:02:05,217 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:05,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:02:05,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-16 06:02:05,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:02:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:05,222 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,223 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 empty. 2023-02-16 06:02:05,223 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,224 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 06:02:05,239 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:05,240 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1ee38bb39f3c94574b7eddb7026c31c0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp 2023-02-16 06:02:05,246 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:05,246 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 1ee38bb39f3c94574b7eddb7026c31c0, disabling compactions & flushes 2023-02-16 06:02:05,246 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,246 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,246 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. after waiting 0 ms 2023-02-16 06:02:05,246 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,246 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,246 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 1ee38bb39f3c94574b7eddb7026c31c0: 2023-02-16 06:02:05,248 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:02:05,249 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676527325249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527325249"}]},"ts":"1676527325249"} 2023-02-16 06:02:05,250 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:02:05,251 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:02:05,251 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527325251"}]},"ts":"1676527325251"} 2023-02-16 06:02:05,252 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-16 06:02:05,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:05,256 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:05,256 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:05,256 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:05,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, ASSIGN}] 2023-02-16 06:02:05,258 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, ASSIGN 2023-02-16 06:02:05,259 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35513,1676527324158; forceNewPlan=false, retain=false 2023-02-16 06:02:05,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:05,409 INFO [jenkins-hbase4:39287] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:02:05,409 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1ee38bb39f3c94574b7eddb7026c31c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,409 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676527325409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527325409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527325409"}]},"ts":"1676527325409"} 2023-02-16 06:02:05,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 1ee38bb39f3c94574b7eddb7026c31c0, server=jenkins-hbase4.apache.org,35513,1676527324158}] 2023-02-16 06:02:05,477 INFO [RS:1;jenkins-hbase4:35513] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35513%2C1676527324158, suffix=, logDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,35513,1676527324158, archiveDir=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/oldWALs, maxLogs=32 2023-02-16 06:02:05,496 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK] 2023-02-16 06:02:05,496 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK] 2023-02-16 06:02:05,499 INFO [RS:1;jenkins-hbase4:35513] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/WALs/jenkins-hbase4.apache.org,35513,1676527324158/jenkins-hbase4.apache.org%2C35513%2C1676527324158.1676527325478 2023-02-16 06:02:05,499 DEBUG [RS:1;jenkins-hbase4:35513] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41009,DS-d8d8ec83-2375-44a0-98bb-6096c167ad23,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-9d3ac561-5756-415c-ae1d-9c32a48a43b2,DISK]] 2023-02-16 06:02:05,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:05,564 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,564 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:02:05,565 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:02:05,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ee38bb39f3c94574b7eddb7026c31c0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:05,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:05,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,569 INFO [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,570 DEBUG [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1 2023-02-16 06:02:05,570 DEBUG [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1 2023-02-16 06:02:05,571 INFO [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ee38bb39f3c94574b7eddb7026c31c0 columnFamilyName f1 2023-02-16 06:02:05,571 INFO [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] regionserver.HStore(310): Store=1ee38bb39f3c94574b7eddb7026c31c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:05,571 INFO [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,572 DEBUG [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2 2023-02-16 06:02:05,572 DEBUG [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2 2023-02-16 06:02:05,573 INFO [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ee38bb39f3c94574b7eddb7026c31c0 columnFamilyName f2 2023-02-16 06:02:05,573 INFO [StoreOpener-1ee38bb39f3c94574b7eddb7026c31c0-1] regionserver.HStore(310): Store=1ee38bb39f3c94574b7eddb7026c31c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:05,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:02:05,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:05,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:05,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1ee38bb39f3c94574b7eddb7026c31c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72866007, jitterRate=0.08578811585903168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:02:05,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1ee38bb39f3c94574b7eddb7026c31c0: 2023-02-16 06:02:05,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0., pid=12, masterSystemTime=1676527325564 2023-02-16 06:02:05,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1ee38bb39f3c94574b7eddb7026c31c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,585 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676527325584"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527325584"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527325584"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527325584"}]},"ts":"1676527325584"} 2023-02-16 06:02:05,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 06:02:05,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 1ee38bb39f3c94574b7eddb7026c31c0, server=jenkins-hbase4.apache.org,35513,1676527324158 in 175 msec 2023-02-16 06:02:05,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 06:02:05,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, ASSIGN in 332 msec 2023-02-16 06:02:05,590 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:02:05,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527325590"}]},"ts":"1676527325590"} 2023-02-16 06:02:05,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-16 06:02:05,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:02:05,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 376 msec 2023-02-16 06:02:05,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:05,826 INFO [Listener at localhost/45817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-16 06:02:05,826 DEBUG [Listener at localhost/45817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-16 06:02:05,826 INFO [Listener at localhost/45817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:02:05,828 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-16 06:02:05,828 INFO [Listener at localhost/45817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:02:05,829 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-16 06:02:05,829 INFO [Listener at localhost/45817] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:02:05,842 DEBUG [hconnection-0x7a6eea58-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:05,854 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:05,862 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,952 INFO [Listener at localhost/45817] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:02:05,952 INFO [Listener at localhost/45817] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:02:05,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 06:02:05,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527325953 (current time:1676527325953). 2023-02-16 06:02:05,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:02:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] zookeeper.ReadOnlyZKClient(139): Connect 0x069291a5 to 127.0.0.1:54484 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:05,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1952285b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:05,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:05,958 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:05,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x069291a5 to 127.0.0.1:54484 2023-02-16 06:02:05,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:05,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:02:05,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 06:02:05,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 06:02:05,963 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 06:02:05,963 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676527925963 2023-02-16 06:02:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 06:02:05,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:05,965 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:02:05,967 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 06:02:05,967 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:02:05,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 06:02:05,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 6 msec 2023-02-16 06:02:05,969 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 06:02:05,969 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676527925969 2023-02-16 06:02:05,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 06:02:05,976 INFO [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 06:02:05,976 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:05,977 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 06:02:05,977 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 06:02:05,977 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 06:02:05,977 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 06:02:05,984 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:05,984 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:05,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:05,984 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:05,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:05,985 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,985 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 06:02:05,985 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 06:02:05,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 06:02:05,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 06:02:05,986 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 06:02:05,986 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:05,986 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35513,1676527324158' joining acquired barrier for procedure (foo) in zk 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 06:02:05,987 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34343,1676527324131' joining acquired barrier for procedure (foo) in zk 2023-02-16 06:02:05,989 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,989 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:05,989 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,989 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,989 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:05,989 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,989 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:02:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:05,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35513,1676527324158' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 06:02:05,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c953455[Count = 0] remaining members to acquire global barrier 2023-02-16 06:02:05,991 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 06:02:05,991 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 06:02:05,992 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 06:02:05,992 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 06:02:05,992 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 06:02:05,992 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34343,1676527324131' in zk 2023-02-16 06:02:05,992 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:05,992 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:02:05,992 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 06:02:05,992 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:02:05,992 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:05,992 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. started... 2023-02-16 06:02:05,992 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1ee38bb39f3c94574b7eddb7026c31c0 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 06:02:05,994 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 06:02:05,994 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:05,994 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 06:02:06,006 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f1/59c741401de04094a518c90b046034cc 2023-02-16 06:02:06,023 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 2023-02-16 06:02:06,026 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f1/59c741401de04094a518c90b046034cc as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc 2023-02-16 06:02:06,029 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:02:06,030 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 2023-02-16 06:02:06,034 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:02:06,034 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 1ee38bb39f3c94574b7eddb7026c31c0 in 42ms, sequenceid=5, compaction requested=false 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1ee38bb39f3c94574b7eddb7026c31c0: 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.' region-info for snapshot=foo 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc] hfiles 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc for snapshot=foo 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4] hfiles 2023-02-16 06:02:06,035 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 for snapshot=foo 2023-02-16 06:02:06,040 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. completed. 2023-02-16 06:02:06,041 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,041 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 06:02:06,041 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 06:02:06,041 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,041 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 06:02:06,041 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35513,1676527324158' in zk 2023-02-16 06:02:06,043 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,043 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 06:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:06,043 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:06,043 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 06:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:02:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,35513,1676527324158': 2023-02-16 06:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35513,1676527324158' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 06:02:06,046 INFO [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 06:02:06,046 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:02:06,046 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:02:06,046 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 06:02:06,046 INFO [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:02:06,048 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:06,048 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:06,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,048 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:06,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:06,049 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,050 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,050 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 06:02:06,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 06:02:06,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:06,055 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:06,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 06:02:06,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:06,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:06,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:06,055 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 06:02:06,056 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 06:02:06,056 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,056 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:02:06,056 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,056 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 06:02:06,056 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 06:02:06,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:06,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:06,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.hbase-snapshot/.tmp/foo 2023-02-16 06:02:06,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:06,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:06,067 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:06,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 06:02:06,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:02:06,069 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:02:06,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.hbase-snapshot/.tmp/foo to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.hbase-snapshot/foo 2023-02-16 06:02:06,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-16 06:02:06,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.hbase-snapshot/.tmp/foo 2023-02-16 06:02:06,098 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.hbase-snapshot/.tmp/foo 2023-02-16 06:02:06,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676527325963Consolidate snapshot: foo at 1676527326056 (+93 ms)Loading Region manifests for foo at 1676527326056Writing data manifest for foo at 1676527326059 (+3 ms)Verifying snapshot: foo at 1676527326075 (+16 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676527326097 (+22 ms) 2023-02-16 06:02:06,099 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 06:02:06,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 135 msec 2023-02-16 06:02:06,269 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:06,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 06:02:06,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:02:06,270 INFO [Listener at localhost/45817] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:02:06,274 INFO [Listener at localhost/45817] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:02:06,278 INFO [Listener at localhost/45817] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:02:06,305 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35513] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,389 INFO [Listener at localhost/45817] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:02:06,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:02:06,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,396 INFO [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 06:02:06,396 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:06,397 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-16 06:02:06,397 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-16 06:02:06,397 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,397 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,398 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:06,398 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:06,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:06,398 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:06,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:06,399 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,399 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:02:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:02:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,400 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 06:02:06,400 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:06,400 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 06:02:06,400 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:06,401 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 06:02:06,401 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 06:02:06,401 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 06:02:06,402 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34343,1676527324131' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 06:02:06,402 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 06:02:06,402 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:02:06,402 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,402 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. started... 2023-02-16 06:02:06,402 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1ee38bb39f3c94574b7eddb7026c31c0 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 06:02:06,404 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,404 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,404 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:06,417 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f1/b40ef3b53c3e4f5c900957f4ef25972f 2023-02-16 06:02:06,436 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f2/75d235de349e481eb74fcc8165b45bd3 2023-02-16 06:02:06,441 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f1/b40ef3b53c3e4f5c900957f4ef25972f as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/b40ef3b53c3e4f5c900957f4ef25972f 2023-02-16 06:02:06,444 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/b40ef3b53c3e4f5c900957f4ef25972f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:02:06,445 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/.tmp/f2/75d235de349e481eb74fcc8165b45bd3 as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/75d235de349e481eb74fcc8165b45bd3 2023-02-16 06:02:06,449 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/75d235de349e481eb74fcc8165b45bd3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:02:06,450 INFO [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 1ee38bb39f3c94574b7eddb7026c31c0 in 48ms, sequenceid=9, compaction requested=false 2023-02-16 06:02:06,451 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1ee38bb39f3c94574b7eddb7026c31c0: 2023-02-16 06:02:06,451 DEBUG [rs(jenkins-hbase4.apache.org,35513,1676527324158)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 06:02:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 06:02:06,451 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,452 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 06:02:06,452 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35513,1676527324158' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 06:02:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,453 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:06,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35513,1676527324158' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-16 06:02:06,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8aab11f[Count = 0] remaining members to acquire global barrier 2023-02-16 06:02:06,455 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-16 06:02:06,455 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,457 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,457 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 06:02:06,459 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,459 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:02:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 06:02:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 06:02:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 06:02:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,35513,1676527324158' in zk 2023-02-16 06:02:06,459 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,34343,1676527324131' in zk 2023-02-16 06:02:06,460 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 06:02:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35513,1676527324158' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 06:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 06:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,34343,1676527324131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 06:02:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,35513,1676527324158': 2023-02-16 06:02:06,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35513,1676527324158' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-16 06:02:06,463 INFO [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-16 06:02:06,463 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:02:06,464 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:02:06,464 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,464 INFO [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:02:06,465 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:06,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:06,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:06,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:06,466 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,466 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,468 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,468 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:06,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 06:02:06,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:02:06,472 DEBUG [(jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:06,473 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,473 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:06,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:06,472 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:06,473 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-16 06:02:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:06,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:06,473 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:02:06,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:06,573 DEBUG [Listener at localhost/45817] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:02:06,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:02:06,578 INFO [Listener at localhost/45817] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676527325953 type: FLUSH version: 2 ttl: 0 2023-02-16 06:02:06,578 DEBUG [Listener at localhost/45817] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40939/user/jenkins/test-data/c317f254-0439-ca36-b2bf-1928e054cba8/foo/013d7d70-757a-4623-87f9-1496a9cc7c30/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,578 INFO [Listener at localhost/45817] snapshot.RestoreSnapshotHelper(239): region to add: 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:06,579 INFO [Listener at localhost/45817] snapshot.RestoreSnapshotHelper(585): clone region=1ee38bb39f3c94574b7eddb7026c31c0 as 1ee38bb39f3c94574b7eddb7026c31c0 in snapshot foo 2023-02-16 06:02:06,579 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1ee38bb39f3c94574b7eddb7026c31c0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40939/user/jenkins/test-data/c317f254-0439-ca36-b2bf-1928e054cba8/foo/013d7d70-757a-4623-87f9-1496a9cc7c30 2023-02-16 06:02:06,585 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:06,585 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59c741401de04094a518c90b046034cc from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,587 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3cf01d1ed9364d7fbf762b3d225ffcf4 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,588 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1ee38bb39f3c94574b7eddb7026c31c0, disabling compactions & flushes 2023-02-16 06:02:06,588 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,588 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,588 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. after waiting 0 ms 2023-02-16 06:02:06,588 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,588 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,588 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1ee38bb39f3c94574b7eddb7026c31c0: 2023-02-16 06:02:06,590 INFO [Listener at localhost/45817] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676527325953 type: FLUSH version: 2 ttl: 0 2023-02-16 06:02:06,590 DEBUG [Listener at localhost/45817] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40939/user/jenkins/test-data/c317f254-0439-ca36-b2bf-1928e054cba8/foo/013d7d70-757a-4623-87f9-1496a9cc7c30 2023-02-16 06:02:06,590 DEBUG [Listener at localhost/45817] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40939/user/jenkins/test-data/c317f254-0439-ca36-b2bf-1928e054cba8/foo/013d7d70-757a-4623-87f9-1496a9cc7c30 2023-02-16 06:02:06,590 DEBUG [Listener at localhost/45817] util.CommonFSUtils(699): |-data/ 2023-02-16 06:02:06,591 DEBUG [Listener at localhost/45817] util.CommonFSUtils(699): |----default/ 2023-02-16 06:02:06,591 DEBUG [Listener at localhost/45817] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-16 06:02:06,591 DEBUG [Listener at localhost/45817] util.CommonFSUtils(699): |----------1ee38bb39f3c94574b7eddb7026c31c0/ 2023-02-16 06:02:06,592 DEBUG [Listener at localhost/45817] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:02:06,592 DEBUG [Listener at localhost/45817] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:02:06,592 DEBUG [Listener at localhost/45817] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=1ee38bb39f3c94574b7eddb7026c31c0-59c741401de04094a518c90b046034cc 2023-02-16 06:02:06,592 DEBUG [Listener at localhost/45817] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:02:06,592 DEBUG [Listener at localhost/45817] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=1ee38bb39f3c94574b7eddb7026c31c0-3cf01d1ed9364d7fbf762b3d225ffcf4 hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/b40ef3b53c3e4f5c900957f4ef25972f hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/75d235de349e481eb74fcc8165b45bd3 2023-02-16 06:02:06,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 06:02:06,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 06:02:06,600 INFO [Listener at localhost/45817] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,601 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:06,604 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527326604"}]},"ts":"1676527326604"} 2023-02-16 06:02:06,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-16 06:02:06,606 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-16 06:02:06,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, UNASSIGN}] 2023-02-16 06:02:06,608 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, UNASSIGN 2023-02-16 06:02:06,608 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1ee38bb39f3c94574b7eddb7026c31c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:06,608 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676527326608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527326608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527326608"}]},"ts":"1676527326608"} 2023-02-16 06:02:06,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 1ee38bb39f3c94574b7eddb7026c31c0, server=jenkins-hbase4.apache.org,35513,1676527324158}] 2023-02-16 06:02:06,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:06,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:06,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1ee38bb39f3c94574b7eddb7026c31c0, disabling compactions & flushes 2023-02-16 06:02:06,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. after waiting 0 ms 2023-02-16 06:02:06,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:02:06,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0. 2023-02-16 06:02:06,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1ee38bb39f3c94574b7eddb7026c31c0: 2023-02-16 06:02:06,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:06,767 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1ee38bb39f3c94574b7eddb7026c31c0, regionState=CLOSED 2023-02-16 06:02:06,767 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676527326767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527326767"}]},"ts":"1676527326767"} 2023-02-16 06:02:06,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 06:02:06,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 1ee38bb39f3c94574b7eddb7026c31c0, server=jenkins-hbase4.apache.org,35513,1676527324158 in 159 msec 2023-02-16 06:02:06,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 06:02:06,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=1ee38bb39f3c94574b7eddb7026c31c0, UNASSIGN in 162 msec 2023-02-16 06:02:06,771 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527326771"}]},"ts":"1676527326771"} 2023-02-16 06:02:06,772 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-16 06:02:06,773 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-16 06:02:06,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 173 msec 2023-02-16 06:02:06,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:06,907 INFO [Listener at localhost/45817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-16 06:02:06,908 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,911 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,911 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:02:06,914 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:06,916 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1, FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2, FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/recovered.edits] 2023-02-16 06:02:06,919 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/59c741401de04094a518c90b046034cc 2023-02-16 06:02:06,920 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/b40ef3b53c3e4f5c900957f4ef25972f to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f1/b40ef3b53c3e4f5c900957f4ef25972f 2023-02-16 06:02:06,923 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/3cf01d1ed9364d7fbf762b3d225ffcf4 2023-02-16 06:02:06,924 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/75d235de349e481eb74fcc8165b45bd3 to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/f2/75d235de349e481eb74fcc8165b45bd3 2023-02-16 06:02:06,927 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/recovered.edits/12.seqid to hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0/recovered.edits/12.seqid 2023-02-16 06:02:06,927 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/1ee38bb39f3c94574b7eddb7026c31c0 2023-02-16 06:02:06,927 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 06:02:06,929 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,931 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-16 06:02:06,932 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-16 06:02:06,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-16 06:02:06,938 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527326938"}]},"ts":"9223372036854775807"} 2023-02-16 06:02:06,939 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 06:02:06,939 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1ee38bb39f3c94574b7eddb7026c31c0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676527325216.1ee38bb39f3c94574b7eddb7026c31c0.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 06:02:06,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-16 06:02:06,940 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676527326939"}]},"ts":"9223372036854775807"} 2023-02-16 06:02:06,941 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-16 06:02:06,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 06:02:06,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 36 msec 2023-02-16 06:02:07,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39287] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:02:07,014 INFO [Listener at localhost/45817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-16 06:02:07,014 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:02:07,014 INFO [Listener at localhost/45817] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:02:07,014 DEBUG [Listener at localhost/45817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dcefd95 to 127.0.0.1:54484 2023-02-16 06:02:07,015 DEBUG [Listener at localhost/45817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,015 DEBUG [Listener at localhost/45817] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:02:07,015 DEBUG [Listener at localhost/45817] util.JVMClusterUtil(257): Found active master hash=1939843835, stopped=false 2023-02-16 06:02:07,015 INFO [Listener at localhost/45817] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:07,017 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:07,017 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:07,017 INFO [Listener at localhost/45817] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:02:07,017 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:07,017 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:07,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:07,019 DEBUG [Listener at localhost/45817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c574a2a to 127.0.0.1:54484 2023-02-16 06:02:07,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:07,019 DEBUG [Listener at localhost/45817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:07,019 INFO [Listener at localhost/45817] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34343,1676527324131' ***** 2023-02-16 06:02:07,020 INFO [Listener at localhost/45817] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:02:07,020 INFO [Listener at localhost/45817] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35513,1676527324158' ***** 2023-02-16 06:02:07,020 INFO [Listener at localhost/45817] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:02:07,020 INFO [RS:0;jenkins-hbase4:34343] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:02:07,020 INFO [RS:1;jenkins-hbase4:35513] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:02:07,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:02:07,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:02:07,020 INFO [RS:0;jenkins-hbase4:34343] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:02:07,020 INFO [RS:1;jenkins-hbase4:35513] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:02:07,024 INFO [RS:1;jenkins-hbase4:35513] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:02:07,024 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:07,024 DEBUG [RS:1;jenkins-hbase4:35513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62263600 to 127.0.0.1:54484 2023-02-16 06:02:07,024 DEBUG [RS:1;jenkins-hbase4:35513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,025 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35513,1676527324158; all regions closed. 2023-02-16 06:02:07,024 INFO [RS:0;jenkins-hbase4:34343] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:02:07,025 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(3304): Received CLOSE for 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:07,035 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:07,035 DEBUG [RS:0;jenkins-hbase4:34343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32f141a5 to 127.0.0.1:54484 2023-02-16 06:02:07,035 DEBUG [RS:0;jenkins-hbase4:34343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,035 INFO [RS:0;jenkins-hbase4:34343] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:02:07,035 INFO [RS:0;jenkins-hbase4:34343] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:02:07,035 INFO [RS:0;jenkins-hbase4:34343] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:02:07,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9bfed524a1b81229b0feb01bc5621c5c, disabling compactions & flushes 2023-02-16 06:02:07,036 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:02:07,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. after waiting 0 ms 2023-02-16 06:02:07,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:07,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 9bfed524a1b81229b0feb01bc5621c5c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:02:07,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:02:07,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:02:07,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:02:07,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:02:07,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:02:07,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-16 06:02:07,044 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 06:02:07,044 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1479): Online Regions={9bfed524a1b81229b0feb01bc5621c5c=hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 06:02:07,044 DEBUG [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1505): Waiting on 1588230740, 9bfed524a1b81229b0feb01bc5621c5c 2023-02-16 06:02:07,046 DEBUG [RS:1;jenkins-hbase4:35513] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/oldWALs 2023-02-16 06:02:07,046 INFO [RS:1;jenkins-hbase4:35513] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35513%2C1676527324158:(num 1676527325478) 2023-02-16 06:02:07,046 DEBUG [RS:1;jenkins-hbase4:35513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,046 INFO [RS:1;jenkins-hbase4:35513] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:07,046 INFO [RS:1;jenkins-hbase4:35513] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 06:02:07,046 INFO [RS:1;jenkins-hbase4:35513] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:02:07,046 INFO [RS:1;jenkins-hbase4:35513] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:02:07,047 INFO [RS:1;jenkins-hbase4:35513] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:02:07,047 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:07,048 INFO [RS:1;jenkins-hbase4:35513] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35513 2023-02-16 06:02:07,050 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:07,050 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:07,050 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:07,050 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35513,1676527324158 2023-02-16 06:02:07,050 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a63cd7c rejected from java.util.concurrent.ThreadPoolExecutor@3e5c5ee8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,050 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:07,050 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e432541 rejected from java.util.concurrent.ThreadPoolExecutor@3e5c5ee8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,050 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35513,1676527324158] 2023-02-16 06:02:07,051 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35513,1676527324158; numProcessing=1 2023-02-16 06:02:07,053 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:07,053 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:07,053 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35513,1676527324158 already deleted, retry=false 2023-02-16 06:02:07,053 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35513,1676527324158 expired; onlineServers=1 2023-02-16 06:02:07,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/.tmp/info/75f5b58ab5a0411b88e4f0954c27cd64 2023-02-16 06:02:07,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/.tmp/info/7f53807f388f490381741423d160cf6e 2023-02-16 06:02:07,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/.tmp/info/75f5b58ab5a0411b88e4f0954c27cd64 as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/info/75f5b58ab5a0411b88e4f0954c27cd64 2023-02-16 06:02:07,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f53807f388f490381741423d160cf6e 2023-02-16 06:02:07,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/info/75f5b58ab5a0411b88e4f0954c27cd64, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:02:07,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9bfed524a1b81229b0feb01bc5621c5c in 48ms, sequenceid=6, compaction requested=false 2023-02-16 06:02:07,087 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/.tmp/rep_barrier/5996831d7c0645c8a828ae6bc02e0512 2023-02-16 06:02:07,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/namespace/9bfed524a1b81229b0feb01bc5621c5c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:02:07,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:07,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9bfed524a1b81229b0feb01bc5621c5c: 2023-02-16 06:02:07,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527324728.9bfed524a1b81229b0feb01bc5621c5c. 2023-02-16 06:02:07,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5996831d7c0645c8a828ae6bc02e0512 2023-02-16 06:02:07,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/.tmp/table/78229cd38ffd4b64a4f4d92a1efbb8fb 2023-02-16 06:02:07,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78229cd38ffd4b64a4f4d92a1efbb8fb 2023-02-16 06:02:07,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/.tmp/info/7f53807f388f490381741423d160cf6e as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/info/7f53807f388f490381741423d160cf6e 2023-02-16 06:02:07,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f53807f388f490381741423d160cf6e 2023-02-16 06:02:07,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/info/7f53807f388f490381741423d160cf6e, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 06:02:07,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/.tmp/rep_barrier/5996831d7c0645c8a828ae6bc02e0512 as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/rep_barrier/5996831d7c0645c8a828ae6bc02e0512 2023-02-16 06:02:07,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5996831d7c0645c8a828ae6bc02e0512 2023-02-16 06:02:07,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/rep_barrier/5996831d7c0645c8a828ae6bc02e0512, entries=1, sequenceid=21, filesize=5.1 K 2023-02-16 06:02:07,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/.tmp/table/78229cd38ffd4b64a4f4d92a1efbb8fb as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/table/78229cd38ffd4b64a4f4d92a1efbb8fb 2023-02-16 06:02:07,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78229cd38ffd4b64a4f4d92a1efbb8fb 2023-02-16 06:02:07,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/table/78229cd38ffd4b64a4f4d92a1efbb8fb, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 06:02:07,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 70ms, sequenceid=21, compaction requested=false 2023-02-16 06:02:07,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 06:02:07,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:02:07,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:07,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:02:07,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:07,216 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:07,216 INFO [RS:1;jenkins-hbase4:35513] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35513,1676527324158; zookeeper connection closed. 2023-02-16 06:02:07,217 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1618a173 rejected from java.util.concurrent.ThreadPoolExecutor@3e5c5ee8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,217 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:35513-0x1005bb8b5380002, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:07,217 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cef7f0a rejected from java.util.concurrent.ThreadPoolExecutor@3e5c5ee8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,217 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@748caf9e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@748caf9e 2023-02-16 06:02:07,244 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34343,1676527324131; all regions closed. 2023-02-16 06:02:07,248 DEBUG [RS:0;jenkins-hbase4:34343] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/oldWALs 2023-02-16 06:02:07,248 INFO [RS:0;jenkins-hbase4:34343] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34343%2C1676527324131.meta:.meta(num 1676527324677) 2023-02-16 06:02:07,251 DEBUG [RS:0;jenkins-hbase4:34343] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/oldWALs 2023-02-16 06:02:07,251 INFO [RS:0;jenkins-hbase4:34343] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34343%2C1676527324131:(num 1676527325067) 2023-02-16 06:02:07,251 DEBUG [RS:0;jenkins-hbase4:34343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,251 INFO [RS:0;jenkins-hbase4:34343] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:07,251 INFO [RS:0;jenkins-hbase4:34343] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:02:07,251 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:07,253 INFO [RS:0;jenkins-hbase4:34343] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34343 2023-02-16 06:02:07,254 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34343,1676527324131 2023-02-16 06:02:07,254 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:07,254 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78f5af45 rejected from java.util.concurrent.ThreadPoolExecutor@7cca3483[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,257 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34343,1676527324131] 2023-02-16 06:02:07,257 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34343,1676527324131; numProcessing=2 2023-02-16 06:02:07,258 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34343,1676527324131 already deleted, retry=false 2023-02-16 06:02:07,258 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34343,1676527324131 expired; onlineServers=0 2023-02-16 06:02:07,258 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39287,1676527324064' ***** 2023-02-16 06:02:07,258 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:02:07,259 DEBUG [M:0;jenkins-hbase4:39287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77a03050, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:07,259 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39287,1676527324064 2023-02-16 06:02:07,259 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39287,1676527324064; all regions closed. 2023-02-16 06:02:07,259 DEBUG [M:0;jenkins-hbase4:39287] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:07,259 DEBUG [M:0;jenkins-hbase4:39287] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:02:07,259 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:02:07,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527324327] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527324327,5,FailOnTimeoutGroup] 2023-02-16 06:02:07,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527324327] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527324327,5,FailOnTimeoutGroup] 2023-02-16 06:02:07,259 DEBUG [M:0;jenkins-hbase4:39287] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:02:07,260 INFO [M:0;jenkins-hbase4:39287] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:02:07,260 INFO [M:0;jenkins-hbase4:39287] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:02:07,260 INFO [M:0;jenkins-hbase4:39287] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:02:07,260 DEBUG [M:0;jenkins-hbase4:39287] master.HMaster(1512): Stopping service threads 2023-02-16 06:02:07,260 INFO [M:0;jenkins-hbase4:39287] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:02:07,261 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:07,261 ERROR [M:0;jenkins-hbase4:39287] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:02:07,261 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:07,261 INFO [M:0;jenkins-hbase4:39287] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:02:07,261 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:02:07,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:07,262 DEBUG [M:0;jenkins-hbase4:39287] zookeeper.ZKUtil(398): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 06:02:07,262 WARN [M:0;jenkins-hbase4:39287] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 06:02:07,262 INFO [M:0;jenkins-hbase4:39287] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:02:07,262 INFO [M:0;jenkins-hbase4:39287] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:02:07,262 DEBUG [M:0;jenkins-hbase4:39287] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:02:07,262 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:07,262 DEBUG [M:0;jenkins-hbase4:39287] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:07,262 DEBUG [M:0;jenkins-hbase4:39287] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:02:07,263 DEBUG [M:0;jenkins-hbase4:39287] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:07,263 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.59 KB 2023-02-16 06:02:07,271 INFO [M:0;jenkins-hbase4:39287] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b216d604c1644ed9a31577c779afe4fc 2023-02-16 06:02:07,275 DEBUG [M:0;jenkins-hbase4:39287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b216d604c1644ed9a31577c779afe4fc as hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b216d604c1644ed9a31577c779afe4fc 2023-02-16 06:02:07,278 INFO [M:0;jenkins-hbase4:39287] regionserver.HStore(1080): Added hdfs://localhost:40939/user/jenkins/test-data/8dd6bb66-408e-a857-420b-fe1eddf45d2d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b216d604c1644ed9a31577c779afe4fc, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 06:02:07,279 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/57997, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-16 06:02:07,279 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:07,279 DEBUG [M:0;jenkins-hbase4:39287] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:07,281 INFO [M:0;jenkins-hbase4:39287] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:02:07,281 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:07,282 INFO [M:0;jenkins-hbase4:39287] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39287 2023-02-16 06:02:07,283 DEBUG [M:0;jenkins-hbase4:39287] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39287,1676527324064 already deleted, retry=false 2023-02-16 06:02:07,524 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:02:07,617 INFO [M:0;jenkins-hbase4:39287] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39287,1676527324064; zookeeper connection closed. 2023-02-16 06:02:07,617 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:07,618 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@575bc230 rejected from java.util.concurrent.ThreadPoolExecutor@53645c03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,618 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): master:39287-0x1005bb8b5380000, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:07,618 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ef9521b rejected from java.util.concurrent.ThreadPoolExecutor@53645c03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,717 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:07,718 INFO [RS:0;jenkins-hbase4:34343] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34343,1676527324131; zookeeper connection closed. 2023-02-16 06:02:07,718 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5de1b873 rejected from java.util.concurrent.ThreadPoolExecutor@7cca3483[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,718 DEBUG [Listener at localhost/45817-EventThread] zookeeper.ZKWatcher(600): regionserver:34343-0x1005bb8b5380001, quorum=127.0.0.1:54484, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:07,718 ERROR [Listener at localhost/45817-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25f8f8a5 rejected from java.util.concurrent.ThreadPoolExecutor@7cca3483[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:07,718 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a964276] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a964276 2023-02-16 06:02:07,718 INFO [Listener at localhost/45817] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:02:07,718 WARN [Listener at localhost/45817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:02:07,722 INFO [Listener at localhost/45817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:07,827 WARN [BP-667570631-172.31.14.131-1676527323274 heartbeating to localhost/127.0.0.1:40939] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:02:07,827 WARN [BP-667570631-172.31.14.131-1676527323274 heartbeating to localhost/127.0.0.1:40939] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-667570631-172.31.14.131-1676527323274 (Datanode Uuid 9ad17df2-7849-4bbc-a8ac-a56d98e1dfaa) service to localhost/127.0.0.1:40939 2023-02-16 06:02:07,828 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/dfs/data/data3/current/BP-667570631-172.31.14.131-1676527323274] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:07,828 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/dfs/data/data4/current/BP-667570631-172.31.14.131-1676527323274] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:07,829 WARN [Listener at localhost/45817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:02:07,832 INFO [Listener at localhost/45817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:07,933 WARN [BP-667570631-172.31.14.131-1676527323274 heartbeating to localhost/127.0.0.1:40939] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:02:07,933 WARN [BP-667570631-172.31.14.131-1676527323274 heartbeating to localhost/127.0.0.1:40939] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-667570631-172.31.14.131-1676527323274 (Datanode Uuid cb1d3a48-7b23-4afc-9a4b-ee96c48fd0a3) service to localhost/127.0.0.1:40939 2023-02-16 06:02:07,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/dfs/data/data1/current/BP-667570631-172.31.14.131-1676527323274] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:07,934 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/cluster_4530ae78-bee1-3a74-371c-c4ce141ed173/dfs/data/data2/current/BP-667570631-172.31.14.131-1676527323274] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:07,944 INFO [Listener at localhost/45817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:08,057 INFO [Listener at localhost/45817] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:02:08,074 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:02:08,091 INFO [Listener at localhost/45817] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:40939 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:40939 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39287,1676527324064)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45817 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:40939 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:40939 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40939 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:40939 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:40939 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=562 (was 662), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 325), ProcessCount=168 (was 168), AvailableMemoryMB=1659 (was 1750) 2023-02-16 06:02:08,104 INFO [Listener at localhost/45817] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=562, MaxFileDescriptor=60000, SystemLoadAverage=323, ProcessCount=168, AvailableMemoryMB=1659 2023-02-16 06:02:08,121 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/hadoop.log.dir so I do NOT create it in target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4 2023-02-16 06:02:08,121 WARN [Listener at localhost/45817] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 06:02:08,121 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/hadoop.tmp.dir so I do NOT create it in target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4 2023-02-16 06:02:08,121 WARN [Listener at localhost/45817] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/862ac215-20fa-79f0-295a-bd66a8c1fc3b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 06:02:08,121 DEBUG [Listener at localhost/45817] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4 2023-02-16 06:02:08,121 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 06:02:08,121 INFO [Listener at localhost/45817] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591, deleteOnExit=true 2023-02-16 06:02:08,121 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 06:02:08,122 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/test.cache.data in system properties and HBase conf 2023-02-16 06:02:08,122 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 06:02:08,122 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/hadoop.log.dir in system properties and HBase conf 2023-02-16 06:02:08,122 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 06:02:08,122 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 06:02:08,122 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 06:02:08,123 DEBUG [Listener at localhost/45817] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 06:02:08,123 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:02:08,123 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 06:02:08,123 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 06:02:08,123 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:02:08,123 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/nfs.dump.dir in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/java.io.tmpdir in system properties and HBase conf 2023-02-16 06:02:08,124 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 06:02:08,125 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 06:02:08,125 INFO [Listener at localhost/45817] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 06:02:08,129 WARN [Listener at localhost/45817] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:02:08,129 WARN [Listener at localhost/45817] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:02:08,178 WARN [Listener at localhost/45817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:02:08,179 INFO [Listener at localhost/45817] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:02:08,185 INFO [Listener at localhost/45817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/java.io.tmpdir/Jetty_localhost_46275_hdfs____.w7yzk8/webapp 2023-02-16 06:02:08,282 INFO [Listener at localhost/45817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46275 2023-02-16 06:02:08,287 WARN [Listener at localhost/45817] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 06:02:08,287 WARN [Listener at localhost/45817] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 06:02:08,327 WARN [Listener at localhost/39751] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:02:08,339 WARN [Listener at localhost/39751] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:02:08,340 WARN [Listener at localhost/39751] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:02:08,341 INFO [Listener at localhost/39751] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:02:08,349 INFO [Listener at localhost/39751] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/java.io.tmpdir/Jetty_localhost_35441_datanode____9z2cty/webapp 2023-02-16 06:02:08,447 INFO [Listener at localhost/39751] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35441 2023-02-16 06:02:08,459 WARN [Listener at localhost/46601] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:02:08,470 WARN [Listener at localhost/46601] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 06:02:08,472 WARN [Listener at localhost/46601] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 06:02:08,473 INFO [Listener at localhost/46601] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 06:02:08,481 INFO [Listener at localhost/46601] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/java.io.tmpdir/Jetty_localhost_34839_datanode____gnnt38/webapp 2023-02-16 06:02:08,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x555f732bd67f04bd: Processing first storage report for DS-70235751-ff5b-43b3-9ed6-1b9070195e56 from datanode d74a1084-e9e8-4ff9-b6ea-fea13d2a873f 2023-02-16 06:02:08,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x555f732bd67f04bd: from storage DS-70235751-ff5b-43b3-9ed6-1b9070195e56 node DatanodeRegistration(127.0.0.1:35213, datanodeUuid=d74a1084-e9e8-4ff9-b6ea-fea13d2a873f, infoPort=46743, infoSecurePort=0, ipcPort=46601, storageInfo=lv=-57;cid=testClusterID;nsid=358784845;c=1676527328132), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:08,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x555f732bd67f04bd: Processing first storage report for DS-2a45660b-b94a-48a9-be8d-6dcd1d621ee1 from datanode d74a1084-e9e8-4ff9-b6ea-fea13d2a873f 2023-02-16 06:02:08,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x555f732bd67f04bd: from storage DS-2a45660b-b94a-48a9-be8d-6dcd1d621ee1 node DatanodeRegistration(127.0.0.1:35213, datanodeUuid=d74a1084-e9e8-4ff9-b6ea-fea13d2a873f, infoPort=46743, infoSecurePort=0, ipcPort=46601, storageInfo=lv=-57;cid=testClusterID;nsid=358784845;c=1676527328132), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:08,577 INFO [Listener at localhost/46601] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34839 2023-02-16 06:02:08,584 WARN [Listener at localhost/35655] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 06:02:08,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x396860ce88ba5fac: Processing first storage report for DS-46e169c1-3aa4-4152-9621-92bd354a671c from datanode 4e47c406-4bfb-4418-bbc0-68514d968de2 2023-02-16 06:02:08,676 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x396860ce88ba5fac: from storage DS-46e169c1-3aa4-4152-9621-92bd354a671c node DatanodeRegistration(127.0.0.1:35821, datanodeUuid=4e47c406-4bfb-4418-bbc0-68514d968de2, infoPort=45835, infoSecurePort=0, ipcPort=35655, storageInfo=lv=-57;cid=testClusterID;nsid=358784845;c=1676527328132), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-16 06:02:08,676 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x396860ce88ba5fac: Processing first storage report for DS-6a270893-9934-464f-8571-ea55e1265543 from datanode 4e47c406-4bfb-4418-bbc0-68514d968de2 2023-02-16 06:02:08,676 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x396860ce88ba5fac: from storage DS-6a270893-9934-464f-8571-ea55e1265543 node DatanodeRegistration(127.0.0.1:35821, datanodeUuid=4e47c406-4bfb-4418-bbc0-68514d968de2, infoPort=45835, infoSecurePort=0, ipcPort=35655, storageInfo=lv=-57;cid=testClusterID;nsid=358784845;c=1676527328132), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 06:02:08,690 DEBUG [Listener at localhost/35655] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4 2023-02-16 06:02:08,692 INFO [Listener at localhost/35655] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/zookeeper_0, clientPort=64011, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 06:02:08,693 INFO [Listener at localhost/35655] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64011 2023-02-16 06:02:08,693 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,694 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,707 INFO [Listener at localhost/35655] util.FSUtils(479): Created version file at hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b with version=8 2023-02-16 06:02:08,707 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,708 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,709 INFO [Listener at localhost/35655] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/hbase-staging 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:02:08,711 INFO [Listener at localhost/35655] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:02:08,712 INFO [Listener at localhost/35655] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36191 2023-02-16 06:02:08,712 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,713 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,713 INFO [Listener at localhost/35655] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36191 connecting to ZooKeeper ensemble=127.0.0.1:64011 2023-02-16 06:02:08,721 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:361910x0, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:02:08,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36191-0x1005bb8c7780000 connected 2023-02-16 06:02:08,746 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:08,747 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:08,747 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:02:08,748 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36191 2023-02-16 06:02:08,748 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36191 2023-02-16 06:02:08,748 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36191 2023-02-16 06:02:08,748 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36191 2023-02-16 06:02:08,749 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36191 2023-02-16 06:02:08,749 INFO [Listener at localhost/35655] master.HMaster(444): hbase.rootdir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b, hbase.cluster.distributed=false 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:02:08,761 INFO [Listener at localhost/35655] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:02:08,762 INFO [Listener at localhost/35655] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45201 2023-02-16 06:02:08,762 INFO [Listener at localhost/35655] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:02:08,763 DEBUG [Listener at localhost/35655] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:02:08,763 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,764 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,765 INFO [Listener at localhost/35655] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45201 connecting to ZooKeeper ensemble=127.0.0.1:64011 2023-02-16 06:02:08,767 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:452010x0, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:02:08,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45201-0x1005bb8c7780001 connected 2023-02-16 06:02:08,769 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:08,770 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:08,770 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:02:08,771 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45201 2023-02-16 06:02:08,771 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45201 2023-02-16 06:02:08,771 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45201 2023-02-16 06:02:08,771 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45201 2023-02-16 06:02:08,771 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45201 2023-02-16 06:02:08,782 INFO [Listener at localhost/35655] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 06:02:08,782 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,782 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,782 INFO [Listener at localhost/35655] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 06:02:08,782 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 06:02:08,783 INFO [Listener at localhost/35655] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 06:02:08,783 INFO [Listener at localhost/35655] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 06:02:08,783 INFO [Listener at localhost/35655] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38583 2023-02-16 06:02:08,783 INFO [Listener at localhost/35655] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 06:02:08,784 DEBUG [Listener at localhost/35655] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:02:08,784 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,785 INFO [Listener at localhost/35655] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,786 INFO [Listener at localhost/35655] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38583 connecting to ZooKeeper ensemble=127.0.0.1:64011 2023-02-16 06:02:08,788 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:385830x0, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 06:02:08,789 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): regionserver:385830x0, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:08,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38583-0x1005bb8c7780002 connected 2023-02-16 06:02:08,790 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:08,790 DEBUG [Listener at localhost/35655] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 06:02:08,790 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38583 2023-02-16 06:02:08,790 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38583 2023-02-16 06:02:08,791 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38583 2023-02-16 06:02:08,791 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38583 2023-02-16 06:02:08,791 DEBUG [Listener at localhost/35655] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38583 2023-02-16 06:02:08,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,793 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:02:08,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,795 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:08,795 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:08,795 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:08,795 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:08,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:02:08,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 06:02:08,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36191,1676527328710 from backup master directory 2023-02-16 06:02:08,799 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,799 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 06:02:08,799 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:02:08,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/hbase.id with ID: 8f3fe6db-3358-473f-9c34-33c6d05b69d2 2023-02-16 06:02:08,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 06:02:08,817 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:08,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x579f76bb to 127.0.0.1:64011 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:08,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d440ecb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:08,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:08,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 06:02:08,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:08,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store-tmp 2023-02-16 06:02:08,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:08,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:02:08,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:08,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:08,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:02:08,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:08,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:08,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:08,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/WALs/jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36191%2C1676527328710, suffix=, logDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/WALs/jenkins-hbase4.apache.org,36191,1676527328710, archiveDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/oldWALs, maxLogs=10 2023-02-16 06:02:08,852 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK] 2023-02-16 06:02:08,852 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK] 2023-02-16 06:02:08,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/WALs/jenkins-hbase4.apache.org,36191,1676527328710/jenkins-hbase4.apache.org%2C36191%2C1676527328710.1676527328840 2023-02-16 06:02:08,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK]] 2023-02-16 06:02:08,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:08,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:08,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:08,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:08,855 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:08,856 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 06:02:08,857 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 06:02:08,857 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:08,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:08,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:08,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 06:02:08,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:08,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66783555, jitterRate=-0.004847481846809387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:02:08,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:08,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 06:02:08,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 06:02:08,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 06:02:08,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 06:02:08,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 06:02:08,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 06:02:08,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 06:02:08,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 06:02:08,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 06:02:08,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 06:02:08,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 06:02:08,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 06:02:08,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 06:02:08,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 06:02:08,881 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:08,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 06:02:08,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 06:02:08,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 06:02:08,883 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:08,883 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:08,883 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:08,883 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:08,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36191,1676527328710, sessionid=0x1005bb8c7780000, setting cluster-up flag (Was=false) 2023-02-16 06:02:08,890 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:08,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 06:02:08,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,897 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:08,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 06:02:08,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:08,904 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.hbase-snapshot/.tmp 2023-02-16 06:02:08,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 06:02:08,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:08,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:08,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:08,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 06:02:08,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 06:02:08,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:08,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:02:08,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676527358908 2023-02-16 06:02:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 06:02:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 06:02:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 06:02:08,908 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:02:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 06:02:08,909 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 06:02:08,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 06:02:08,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 06:02:08,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:08,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 06:02:08,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 06:02:08,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 06:02:08,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 06:02:08,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 06:02:08,910 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:08,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527328910,5,FailOnTimeoutGroup] 2023-02-16 06:02:08,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527328910,5,FailOnTimeoutGroup] 2023-02-16 06:02:08,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:08,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 06:02:08,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:08,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:08,919 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:08,919 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:08,920 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b 2023-02-16 06:02:08,928 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:08,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:02:08,930 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/info 2023-02-16 06:02:08,931 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:02:08,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:08,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:02:08,932 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:02:08,933 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:02:08,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:08,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:02:08,934 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/table 2023-02-16 06:02:08,934 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:02:08,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:08,935 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740 2023-02-16 06:02:08,935 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740 2023-02-16 06:02:08,937 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:02:08,938 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:02:08,939 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:08,940 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60759764, jitterRate=-0.09460896253585815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:02:08,940 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:02:08,940 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:02:08,940 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:02:08,940 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:02:08,940 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:02:08,940 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:02:08,940 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:08,940 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:02:08,941 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 06:02:08,941 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 06:02:08,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 06:02:08,941 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 06:02:08,943 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 06:02:08,993 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(952): ClusterId : 8f3fe6db-3358-473f-9c34-33c6d05b69d2 2023-02-16 06:02:08,993 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(952): ClusterId : 8f3fe6db-3358-473f-9c34-33c6d05b69d2 2023-02-16 06:02:08,993 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:02:08,993 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 06:02:08,995 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:02:08,995 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:02:08,995 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 06:02:08,995 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 06:02:08,999 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:02:09,000 DEBUG [RS:0;jenkins-hbase4:45201] zookeeper.ReadOnlyZKClient(139): Connect 0x768aadfd to 127.0.0.1:64011 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:09,000 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 06:02:09,001 DEBUG [RS:1;jenkins-hbase4:38583] zookeeper.ReadOnlyZKClient(139): Connect 0x64fcc6fb to 127.0.0.1:64011 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:09,004 DEBUG [RS:0;jenkins-hbase4:45201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@784d5d5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:09,004 DEBUG [RS:1;jenkins-hbase4:38583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a3b2414, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:09,004 DEBUG [RS:0;jenkins-hbase4:45201] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c72c68d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:09,004 DEBUG [RS:1;jenkins-hbase4:38583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e04ad8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:09,018 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45201 2023-02-16 06:02:09,018 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38583 2023-02-16 06:02:09,018 INFO [RS:0;jenkins-hbase4:45201] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:02:09,018 INFO [RS:0;jenkins-hbase4:45201] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:02:09,018 INFO [RS:1;jenkins-hbase4:38583] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 06:02:09,018 INFO [RS:1;jenkins-hbase4:38583] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 06:02:09,018 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:02:09,018 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 06:02:09,019 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36191,1676527328710 with isa=jenkins-hbase4.apache.org/172.31.14.131:45201, startcode=1676527328760 2023-02-16 06:02:09,019 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36191,1676527328710 with isa=jenkins-hbase4.apache.org/172.31.14.131:38583, startcode=1676527328782 2023-02-16 06:02:09,019 DEBUG [RS:0;jenkins-hbase4:45201] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:02:09,019 DEBUG [RS:1;jenkins-hbase4:38583] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 06:02:09,020 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35519, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:02:09,020 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49135, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 06:02:09,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36191] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,023 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b 2023-02-16 06:02:09,023 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b 2023-02-16 06:02:09,023 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39751 2023-02-16 06:02:09,023 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39751 2023-02-16 06:02:09,023 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:02:09,023 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 06:02:09,028 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:09,028 DEBUG [RS:1;jenkins-hbase4:38583] zookeeper.ZKUtil(162): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,028 DEBUG [RS:0;jenkins-hbase4:45201] zookeeper.ZKUtil(162): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,029 WARN [RS:1;jenkins-hbase4:38583] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:02:09,029 WARN [RS:0;jenkins-hbase4:45201] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 06:02:09,029 INFO [RS:1;jenkins-hbase4:38583] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:09,029 INFO [RS:0;jenkins-hbase4:45201] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:09,029 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,029 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,029 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38583,1676527328782] 2023-02-16 06:02:09,029 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45201,1676527328760] 2023-02-16 06:02:09,033 DEBUG [RS:0;jenkins-hbase4:45201] zookeeper.ZKUtil(162): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,034 DEBUG [RS:1;jenkins-hbase4:38583] zookeeper.ZKUtil(162): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,034 DEBUG [RS:0;jenkins-hbase4:45201] zookeeper.ZKUtil(162): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,034 DEBUG [RS:1;jenkins-hbase4:38583] zookeeper.ZKUtil(162): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,034 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:02:09,034 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 06:02:09,035 INFO [RS:1;jenkins-hbase4:38583] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:02:09,035 INFO [RS:0;jenkins-hbase4:45201] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 06:02:09,036 INFO [RS:1;jenkins-hbase4:38583] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:02:09,036 INFO [RS:1;jenkins-hbase4:38583] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:02:09,036 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,036 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:02:09,096 DEBUG [jenkins-hbase4:36191] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 06:02:09,096 DEBUG [jenkins-hbase4:36191] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:09,096 INFO [RS:0;jenkins-hbase4:45201] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 06:02:09,101 INFO [RS:0;jenkins-hbase4:45201] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 06:02:09,101 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,102 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,102 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 06:02:09,102 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,103 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,103 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,103 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,103 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,103 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:02:09,103 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,104 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,104 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,104 DEBUG [RS:1;jenkins-hbase4:38583] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,104 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,104 DEBUG [jenkins-hbase4:36191] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:09,104 DEBUG [jenkins-hbase4:36191] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:09,104 DEBUG [jenkins-hbase4:36191] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:09,105 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,105 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38583,1676527328782, state=OPENING 2023-02-16 06:02:09,105 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,105 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,105 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,105 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,105 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,105 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 06:02:09,106 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,106 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,106 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,106 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,106 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,106 DEBUG [RS:0;jenkins-hbase4:45201] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 06:02:09,106 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 06:02:09,107 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,107 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,107 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,110 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:09,110 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:02:09,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38583,1676527328782}] 2023-02-16 06:02:09,120 INFO [RS:0;jenkins-hbase4:45201] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:02:09,120 INFO [RS:1;jenkins-hbase4:38583] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 06:02:09,120 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45201,1676527328760-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,120 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38583,1676527328782-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,130 INFO [RS:0;jenkins-hbase4:45201] regionserver.Replication(203): jenkins-hbase4.apache.org,45201,1676527328760 started 2023-02-16 06:02:09,130 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45201,1676527328760, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45201, sessionid=0x1005bb8c7780001 2023-02-16 06:02:09,130 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:02:09,130 DEBUG [RS:0;jenkins-hbase4:45201] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,130 DEBUG [RS:0;jenkins-hbase4:45201] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45201,1676527328760' 2023-02-16 06:02:09,130 DEBUG [RS:0;jenkins-hbase4:45201] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:09,130 DEBUG [RS:0;jenkins-hbase4:45201] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45201,1676527328760' 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:09,131 DEBUG [RS:0;jenkins-hbase4:45201] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:02:09,131 INFO [RS:0;jenkins-hbase4:45201] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:02:09,131 INFO [RS:0;jenkins-hbase4:45201] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:02:09,131 INFO [RS:1;jenkins-hbase4:38583] regionserver.Replication(203): jenkins-hbase4.apache.org,38583,1676527328782 started 2023-02-16 06:02:09,131 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38583,1676527328782, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38583, sessionid=0x1005bb8c7780002 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38583,1676527328782' 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38583,1676527328782' 2023-02-16 06:02:09,132 DEBUG [RS:1;jenkins-hbase4:38583] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:09,133 DEBUG [RS:1;jenkins-hbase4:38583] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:09,133 DEBUG [RS:1;jenkins-hbase4:38583] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 06:02:09,133 INFO [RS:1;jenkins-hbase4:38583] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 06:02:09,133 INFO [RS:1;jenkins-hbase4:38583] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 06:02:09,264 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:09,265 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:02:09,266 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:02:09,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 06:02:09,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 06:02:09,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38583%2C1676527328782.meta, suffix=.meta, logDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,38583,1676527328782, archiveDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/oldWALs, maxLogs=32 2023-02-16 06:02:09,287 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK] 2023-02-16 06:02:09,287 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK] 2023-02-16 06:02:09,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,38583,1676527328782/jenkins-hbase4.apache.org%2C38583%2C1676527328782.meta.1676527329272.meta 2023-02-16 06:02:09,290 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK], DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK]] 2023-02-16 06:02:09,290 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:09,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 06:02:09,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 06:02:09,291 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 06:02:09,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 06:02:09,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:09,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 06:02:09,291 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 06:02:09,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 06:02:09,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/info 2023-02-16 06:02:09,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/info 2023-02-16 06:02:09,294 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 06:02:09,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:09,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 06:02:09,295 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:02:09,296 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/rep_barrier 2023-02-16 06:02:09,296 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 06:02:09,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:09,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 06:02:09,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/table 2023-02-16 06:02:09,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/table 2023-02-16 06:02:09,297 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 06:02:09,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:09,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740 2023-02-16 06:02:09,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740 2023-02-16 06:02:09,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 06:02:09,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 06:02:09,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61519706, jitterRate=-0.08328494429588318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 06:02:09,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 06:02:09,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676527329264 2023-02-16 06:02:09,306 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 06:02:09,307 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 06:02:09,308 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38583,1676527328782, state=OPEN 2023-02-16 06:02:09,309 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 06:02:09,309 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 06:02:09,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 06:02:09,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38583,1676527328782 in 199 msec 2023-02-16 06:02:09,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 06:02:09,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 370 msec 2023-02-16 06:02:09,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 409 msec 2023-02-16 06:02:09,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676527329314, completionTime=-1 2023-02-16 06:02:09,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 06:02:09,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 06:02:09,317 DEBUG [hconnection-0x242d404a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:09,318 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:09,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 06:02:09,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676527389320 2023-02-16 06:02:09,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676527449320 2023-02-16 06:02:09,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 06:02:09,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36191,1676527328710-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36191,1676527328710-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36191,1676527328710-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36191, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 06:02:09,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 06:02:09,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:09,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 06:02:09,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:02:09,338 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 06:02:09,338 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:02:09,340 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,341 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995 empty. 2023-02-16 06:02:09,341 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,341 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 06:02:09,350 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:09,351 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => dfae29d564ae75cfd2e3bde69c562995, NAME => 'hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp 2023-02-16 06:02:09,358 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:09,358 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing dfae29d564ae75cfd2e3bde69c562995, disabling compactions & flushes 2023-02-16 06:02:09,358 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,358 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,358 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. after waiting 0 ms 2023-02-16 06:02:09,358 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,358 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,358 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for dfae29d564ae75cfd2e3bde69c562995: 2023-02-16 06:02:09,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:02:09,361 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527329360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527329360"}]},"ts":"1676527329360"} 2023-02-16 06:02:09,362 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:02:09,362 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:02:09,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527329362"}]},"ts":"1676527329362"} 2023-02-16 06:02:09,363 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 06:02:09,366 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:09,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:09,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:09,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:09,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dfae29d564ae75cfd2e3bde69c562995, ASSIGN}] 2023-02-16 06:02:09,369 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dfae29d564ae75cfd2e3bde69c562995, ASSIGN 2023-02-16 06:02:09,369 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dfae29d564ae75cfd2e3bde69c562995, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45201,1676527328760; forceNewPlan=false, retain=false 2023-02-16 06:02:09,519 INFO [jenkins-hbase4:36191] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:02:09,520 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dfae29d564ae75cfd2e3bde69c562995, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,520 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527329520"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527329520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527329520"}]},"ts":"1676527329520"} 2023-02-16 06:02:09,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dfae29d564ae75cfd2e3bde69c562995, server=jenkins-hbase4.apache.org,45201,1676527328760}] 2023-02-16 06:02:09,674 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,674 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 06:02:09,676 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58674, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 06:02:09,679 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,681 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45201%2C1676527328760, suffix=, logDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,45201,1676527328760, archiveDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/oldWALs, maxLogs=32 2023-02-16 06:02:09,696 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK] 2023-02-16 06:02:09,696 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK] 2023-02-16 06:02:09,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,45201,1676527328760/jenkins-hbase4.apache.org%2C45201%2C1676527328760.1676527329681 2023-02-16 06:02:09,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK]] 2023-02-16 06:02:09,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dfae29d564ae75cfd2e3bde69c562995, NAME => 'hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:09,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:09,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,699 INFO [StoreOpener-dfae29d564ae75cfd2e3bde69c562995-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,700 DEBUG [StoreOpener-dfae29d564ae75cfd2e3bde69c562995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/info 2023-02-16 06:02:09,700 DEBUG [StoreOpener-dfae29d564ae75cfd2e3bde69c562995-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/info 2023-02-16 06:02:09,701 INFO [StoreOpener-dfae29d564ae75cfd2e3bde69c562995-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfae29d564ae75cfd2e3bde69c562995 columnFamilyName info 2023-02-16 06:02:09,701 INFO [StoreOpener-dfae29d564ae75cfd2e3bde69c562995-1] regionserver.HStore(310): Store=dfae29d564ae75cfd2e3bde69c562995/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:09,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:09,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:09,707 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dfae29d564ae75cfd2e3bde69c562995; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71071596, jitterRate=0.05904930830001831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 06:02:09,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dfae29d564ae75cfd2e3bde69c562995: 2023-02-16 06:02:09,708 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995., pid=6, masterSystemTime=1676527329674 2023-02-16 06:02:09,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,715 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:09,715 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dfae29d564ae75cfd2e3bde69c562995, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,715 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676527329715"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527329715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527329715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527329715"}]},"ts":"1676527329715"} 2023-02-16 06:02:09,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 06:02:09,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dfae29d564ae75cfd2e3bde69c562995, server=jenkins-hbase4.apache.org,45201,1676527328760 in 196 msec 2023-02-16 06:02:09,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 06:02:09,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dfae29d564ae75cfd2e3bde69c562995, ASSIGN in 351 msec 2023-02-16 06:02:09,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:02:09,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527329720"}]},"ts":"1676527329720"} 2023-02-16 06:02:09,721 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 06:02:09,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:02:09,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 398 msec 2023-02-16 06:02:09,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 06:02:09,728 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:09,728 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:09,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:09,731 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58678, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:09,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 06:02:09,738 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:09,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 06:02:09,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 06:02:09,748 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 06:02:09,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-16 06:02:09,758 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 06:02:09,759 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 06:02:09,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.960sec 2023-02-16 06:02:09,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 06:02:09,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 06:02:09,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 06:02:09,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36191,1676527328710-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 06:02:09,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36191,1676527328710-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 06:02:09,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 06:02:09,797 DEBUG [Listener at localhost/35655] zookeeper.ReadOnlyZKClient(139): Connect 0x49ba3d8c to 127.0.0.1:64011 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:09,799 DEBUG [Listener at localhost/35655] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@707109e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:09,801 DEBUG [hconnection-0x4589ffda-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:09,802 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:09,803 INFO [Listener at localhost/35655] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:09,803 DEBUG [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 06:02:09,806 DEBUG [Listener at localhost/35655] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 06:02:09,807 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54880, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 06:02:09,807 INFO [Listener at localhost/35655] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 06:02:09,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 06:02:09,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 06:02:09,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:54880 deadline: 1676527389808, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 06:02:09,808 INFO [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 06:02:09,811 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 06:02:09,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 06:02:09,812 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 06:02:09,813 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 06:02:09,813 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 06:02:09,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:09,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:09,815 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a empty. 2023-02-16 06:02:09,815 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:09,815 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 06:02:09,823 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 06:02:09,824 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6e77fb4f90bc8ded27009d4434be233a, NAME => 'testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp 2023-02-16 06:02:09,833 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:09,833 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 6e77fb4f90bc8ded27009d4434be233a, disabling compactions & flushes 2023-02-16 06:02:09,834 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:09,834 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:09,834 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. after waiting 0 ms 2023-02-16 06:02:09,834 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:09,834 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:09,834 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:09,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 06:02:09,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676527329836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527329836"}]},"ts":"1676527329836"} 2023-02-16 06:02:09,838 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 06:02:09,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 06:02:09,838 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527329838"}]},"ts":"1676527329838"} 2023-02-16 06:02:09,840 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 06:02:09,843 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 06:02:09,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 06:02:09,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 06:02:09,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 06:02:09,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, ASSIGN}] 2023-02-16 06:02:09,845 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, ASSIGN 2023-02-16 06:02:09,846 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45201,1676527328760; forceNewPlan=false, retain=false 2023-02-16 06:02:09,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:09,996 INFO [jenkins-hbase4:36191] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 06:02:09,996 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6e77fb4f90bc8ded27009d4434be233a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:09,996 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676527329996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527329996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527329996"}]},"ts":"1676527329996"} 2023-02-16 06:02:09,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 6e77fb4f90bc8ded27009d4434be233a, server=jenkins-hbase4.apache.org,45201,1676527328760}] 2023-02-16 06:02:10,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:10,135 INFO [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38583%2C1676527328782, suffix=, logDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,38583,1676527328782, archiveDir=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/oldWALs, maxLogs=32 2023-02-16 06:02:10,149 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK] 2023-02-16 06:02:10,149 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK] 2023-02-16 06:02:10,152 INFO [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,38583,1676527328782/jenkins-hbase4.apache.org%2C38583%2C1676527328782.1676527330135 2023-02-16 06:02:10,153 DEBUG [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35213,DS-70235751-ff5b-43b3-9ed6-1b9070195e56,DISK], DatanodeInfoWithStorage[127.0.0.1:35821,DS-46e169c1-3aa4-4152-9621-92bd354a671c,DISK]] 2023-02-16 06:02:10,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6e77fb4f90bc8ded27009d4434be233a, NAME => 'testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.', STARTKEY => '', ENDKEY => ''} 2023-02-16 06:02:10,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:10,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,155 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,156 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1 2023-02-16 06:02:10,156 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1 2023-02-16 06:02:10,156 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e77fb4f90bc8ded27009d4434be233a columnFamilyName f1 2023-02-16 06:02:10,157 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(310): Store=6e77fb4f90bc8ded27009d4434be233a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:10,157 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,158 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2 2023-02-16 06:02:10,158 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2 2023-02-16 06:02:10,158 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e77fb4f90bc8ded27009d4434be233a columnFamilyName f2 2023-02-16 06:02:10,158 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(310): Store=6e77fb4f90bc8ded27009d4434be233a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:02:10,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:10,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 06:02:10,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6e77fb4f90bc8ded27009d4434be233a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72061324, jitterRate=0.07379740476608276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:02:10,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:10,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a., pid=12, masterSystemTime=1676527330150 2023-02-16 06:02:10,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6e77fb4f90bc8ded27009d4434be233a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,167 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676527330167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676527330167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676527330167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676527330167"}]},"ts":"1676527330167"} 2023-02-16 06:02:10,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 06:02:10,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 6e77fb4f90bc8ded27009d4434be233a, server=jenkins-hbase4.apache.org,45201,1676527328760 in 170 msec 2023-02-16 06:02:10,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 06:02:10,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, ASSIGN in 326 msec 2023-02-16 06:02:10,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 06:02:10,172 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527330171"}]},"ts":"1676527330171"} 2023-02-16 06:02:10,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 06:02:10,176 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 06:02:10,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 365 msec 2023-02-16 06:02:10,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 06:02:10,418 INFO [Listener at localhost/35655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 06:02:10,418 DEBUG [Listener at localhost/35655] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 06:02:10,418 INFO [Listener at localhost/35655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:02:10,420 INFO [Listener at localhost/35655] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 06:02:10,421 INFO [Listener at localhost/35655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 06:02:10,421 INFO [Listener at localhost/35655] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 06:02:10,421 INFO [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 06:02:10,435 DEBUG [hconnection-0x4589ffda-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:10,449 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:10,459 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45201] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,546 INFO [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 06:02:10,546 INFO [Listener at localhost/35655] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 06:02:10,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:02:10,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676527330547 (current time:1676527330547). 2023-02-16 06:02:10,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 06:02:10,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] zookeeper.ReadOnlyZKClient(139): Connect 0x755d60bb to 127.0.0.1:64011 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 06:02:10,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78702849, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 06:02:10,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 06:02:10,554 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 06:02:10,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x755d60bb to 127.0.0.1:64011 2023-02-16 06:02:10,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:10,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 06:02:10,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:02:10,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:02:10,558 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:02:10,558 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676527930558 2023-02-16 06:02:10,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 06:02:10,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 06:02:10,560 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 06:02:10,560 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 06:02:10,560 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 06:02:10,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:02:10,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-16 06:02:10,561 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:02:10,562 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676527930562 2023-02-16 06:02:10,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-16 06:02:10,569 INFO [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-16 06:02:10,569 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:10,570 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-16 06:02:10,570 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 06:02:10,570 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,570 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,572 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:10,572 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:10,572 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,573 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,573 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 06:02:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 06:02:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 06:02:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 06:02:10,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 06:02:10,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 06:02:10,574 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 06:02:10,574 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 06:02:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 06:02:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 06:02:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 06:02:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45201,1676527328760' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 06:02:10,577 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 06:02:10,577 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 06:02:10,578 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38583,1676527328782' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 06:02:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,579 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:10,579 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 06:02:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:10,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45201,1676527328760' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-16 06:02:10,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74802ec7[Count = 0] remaining members to acquire global barrier 2023-02-16 06:02:10,581 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 06:02:10,581 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 06:02:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 06:02:10,582 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,582 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:02:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 06:02:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 06:02:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 06:02:10,582 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38583,1676527328782' in zk 2023-02-16 06:02:10,582 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,583 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. started... 2023-02-16 06:02:10,583 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6e77fb4f90bc8ded27009d4434be233a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 06:02:10,584 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 06:02:10,584 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:10,584 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 06:02:10,600 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f1/d7b02c66467944ebb3addfd7dd223b77 2023-02-16 06:02:10,621 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f2/e1b479a83e3b4733b7d890039a28f9b9 2023-02-16 06:02:10,626 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f1/d7b02c66467944ebb3addfd7dd223b77 as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/d7b02c66467944ebb3addfd7dd223b77 2023-02-16 06:02:10,630 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/d7b02c66467944ebb3addfd7dd223b77, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:02:10,631 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f2/e1b479a83e3b4733b7d890039a28f9b9 as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/e1b479a83e3b4733b7d890039a28f9b9 2023-02-16 06:02:10,636 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/e1b479a83e3b4733b7d890039a28f9b9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 06:02:10,636 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 6e77fb4f90bc8ded27009d4434be233a in 53ms, sequenceid=5, compaction requested=false 2023-02-16 06:02:10,636 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:10,637 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-16 06:02:10,637 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 06:02:10,637 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/d7b02c66467944ebb3addfd7dd223b77] hfiles 2023-02-16 06:02:10,637 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/d7b02c66467944ebb3addfd7dd223b77 for snapshot=testWithMapReduceSingleRegion 2023-02-16 06:02:10,637 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/e1b479a83e3b4733b7d890039a28f9b9] hfiles 2023-02-16 06:02:10,637 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/e1b479a83e3b4733b7d890039a28f9b9 for snapshot=testWithMapReduceSingleRegion 2023-02-16 06:02:10,654 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. completed. 2023-02-16 06:02:10,655 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,655 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 06:02:10,655 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 06:02:10,655 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,655 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 06:02:10,655 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45201,1676527328760' in zk 2023-02-16 06:02:10,659 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,659 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 06:02:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:10,659 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:10,659 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 06:02:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:10,660 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:10,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:02:10,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 06:02:10,662 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 06:02:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 06:02:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:10,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 06:02:10,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45201,1676527328760': 2023-02-16 06:02:10,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45201,1676527328760' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 06:02:10,675 INFO [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-16 06:02:10,675 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:02:10,675 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:02:10,675 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-16 06:02:10,675 INFO [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 06:02:10,677 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,677 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,677 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:10,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,677 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,677 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 06:02:10,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:10,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:10,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,679 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 06:02:10,679 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 06:02:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,680 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:10,681 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 06:02:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,689 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,689 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,690 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 06:02:10,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 06:02:10,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-16 06:02:10,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 06:02:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:10,690 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 06:02:10,691 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 06:02:10,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:10,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 06:02:10,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 06:02:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 06:02:10,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-16 06:02:10,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-16 06:02:10,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 06:02:10,731 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 06:02:10,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676527330559Consolidate snapshot: testWithMapReduceSingleRegion at 1676527330690 (+131 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676527330690Writing data manifest for testWithMapReduceSingleRegion at 1676527330693 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676527330703 (+10 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676527330730 (+27 ms) 2023-02-16 06:02:10,734 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 06:02:10,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 174 msec 2023-02-16 06:02:10,862 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 06:02:10,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 06:02:10,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 06:02:10,864 INFO [Listener at localhost/35655] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 06:02:10,867 INFO [Listener at localhost/35655] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 06:02:10,872 INFO [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 06:02:10,904 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45201] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:10,993 INFO [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 06:02:10,998 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 06:02:11,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 06:02:11,000 INFO [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 06:02:11,000 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:11,000 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 06:02:11,000 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 06:02:11,001 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,001 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,002 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,002 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:11,002 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:11,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:11,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:11,002 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:11,002 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,003 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 06:02:11,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 06:02:11,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 06:02:11,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:11,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 06:02:11,004 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 06:02:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 06:02:11,004 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. started... 2023-02-16 06:02:11,004 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 06:02:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 06:02:11,005 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38583,1676527328782' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 06:02:11,005 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6e77fb4f90bc8ded27009d4434be233a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 06:02:11,006 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,006 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,006 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:11,023 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f1/672bcb4d1e3c4b9ab608a3ec41c407eb 2023-02-16 06:02:11,046 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f2/bce82a9ddd57429da9e7b4179a3a015f 2023-02-16 06:02:11,054 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f1/672bcb4d1e3c4b9ab608a3ec41c407eb as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/672bcb4d1e3c4b9ab608a3ec41c407eb 2023-02-16 06:02:11,058 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/672bcb4d1e3c4b9ab608a3ec41c407eb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:02:11,059 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/.tmp/f2/bce82a9ddd57429da9e7b4179a3a015f as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/bce82a9ddd57429da9e7b4179a3a015f 2023-02-16 06:02:11,063 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/bce82a9ddd57429da9e7b4179a3a015f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 06:02:11,063 INFO [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 6e77fb4f90bc8ded27009d4434be233a in 58ms, sequenceid=9, compaction requested=false 2023-02-16 06:02:11,063 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:11,063 DEBUG [rs(jenkins-hbase4.apache.org,45201,1676527328760)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 06:02:11,064 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 06:02:11,064 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,064 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 06:02:11,064 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45201,1676527328760' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 06:02:11,065 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,065 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:11,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 06:02:11,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:11,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:11,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:02:11,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:11,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45201,1676527328760' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 06:02:11,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70bfa48f[Count = 0] remaining members to acquire global barrier 2023-02-16 06:02:11,068 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 06:02:11,068 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,070 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 06:02:11,070 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 06:02:11,070 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45201,1676527328760' in zk 2023-02-16 06:02:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,070 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 06:02:11,070 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 06:02:11,070 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 06:02:11,070 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38583,1676527328782' in zk 2023-02-16 06:02:11,072 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 06:02:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:11,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:11,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:11,072 DEBUG [member: 'jenkins-hbase4.apache.org,45201,1676527328760' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 06:02:11,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:11,073 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 06:02:11,073 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:11,073 DEBUG [member: 'jenkins-hbase4.apache.org,38583,1676527328782' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 06:02:11,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:11,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:02:11,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:11,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:02:11,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45201,1676527328760': 2023-02-16 06:02:11,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45201,1676527328760' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 06:02:11,075 INFO [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 06:02:11,075 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 06:02:11,075 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 06:02:11,075 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 06:02:11,075 INFO [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 06:02:11,077 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,077 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 06:02:11,077 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,077 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,078 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:11,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 06:02:11,078 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:11,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:02:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,079 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 06:02:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:02:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 06:02:11,080 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 06:02:11,080 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,090 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:11,090 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:11,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:11,090 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 06:02:11,090 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 06:02:11,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 06:02:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:11,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 06:02:11,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 06:02:11,090 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,090 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 06:02:11,090 DEBUG [(jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 06:02:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 06:02:11,091 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 06:02:11,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:11,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 06:02:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 06:02:11,191 DEBUG [Listener at localhost/35655] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 06:02:11,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 06:02:11,278 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/hadoop-2540490610227335535.jar 2023-02-16 06:02:11,281 INFO [Listener at localhost/35655] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676527330547 type: FLUSH version: 2 ttl: 0 2023-02-16 06:02:11,282 DEBUG [Listener at localhost/35655] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30/data/default/testWithMapReduce 2023-02-16 06:02:11,282 INFO [Listener at localhost/35655] snapshot.RestoreSnapshotHelper(239): region to add: 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:11,282 INFO [Listener at localhost/35655] snapshot.RestoreSnapshotHelper(585): clone region=6e77fb4f90bc8ded27009d4434be233a as 6e77fb4f90bc8ded27009d4434be233a in snapshot testWithMapReduceSingleRegion 2023-02-16 06:02:11,283 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6e77fb4f90bc8ded27009d4434be233a, NAME => 'testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30 2023-02-16 06:02:11,288 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:11,288 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d7b02c66467944ebb3addfd7dd223b77 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 06:02:11,291 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e1b479a83e3b4733b7d890039a28f9b9 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 06:02:11,293 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6e77fb4f90bc8ded27009d4434be233a, disabling compactions & flushes 2023-02-16 06:02:11,293 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:11,293 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:11,293 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. after waiting 0 ms 2023-02-16 06:02:11,293 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:11,293 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:11,293 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:11,293 INFO [Listener at localhost/35655] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676527330547 type: FLUSH version: 2 ttl: 0 2023-02-16 06:02:11,293 DEBUG [Listener at localhost/35655] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30 2023-02-16 06:02:11,293 DEBUG [Listener at localhost/35655] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30 2023-02-16 06:02:11,294 DEBUG [Listener at localhost/35655] util.CommonFSUtils(699): |-data/ 2023-02-16 06:02:11,294 DEBUG [Listener at localhost/35655] util.CommonFSUtils(699): |----default/ 2023-02-16 06:02:11,294 DEBUG [Listener at localhost/35655] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 06:02:11,295 DEBUG [Listener at localhost/35655] util.CommonFSUtils(699): |----------6e77fb4f90bc8ded27009d4434be233a/ 2023-02-16 06:02:11,295 DEBUG [Listener at localhost/35655] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 06:02:11,295 DEBUG [Listener at localhost/35655] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 06:02:11,295 DEBUG [Listener at localhost/35655] util.CommonFSUtils(702): |----------------testWithMapReduce=6e77fb4f90bc8ded27009d4434be233a-d7b02c66467944ebb3addfd7dd223b77 2023-02-16 06:02:11,295 DEBUG [Listener at localhost/35655] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 06:02:11,296 DEBUG [Listener at localhost/35655] util.CommonFSUtils(702): |----------------testWithMapReduce=6e77fb4f90bc8ded27009d4434be233a-e1b479a83e3b4733b7d890039a28f9b9 2023-02-16 06:02:11,296 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:11,296 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:11,297 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:11,297 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,171 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/hadoop-7993723815580077651.jar 2023-02-16 06:02:12,171 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,171 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,238 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/hadoop-2267572367415853035.jar 2023-02-16 06:02:12,239 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,239 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,239 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,240 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,240 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,240 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,241 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 06:02:12,241 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 06:02:12,241 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 06:02:12,242 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 06:02:12,242 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 06:02:12,242 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 06:02:12,243 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 06:02:12,243 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 06:02:12,243 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 06:02:12,244 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 06:02:12,244 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 06:02:12,245 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:02:12,245 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:02:12,245 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 06:02:12,246 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 06:02:12,312 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/hadoop-7473797996041162331.jar 2023-02-16 06:02:12,312 DEBUG [Listener at localhost/35655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 06:02:12,317 WARN [Listener at localhost/35655] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 06:02:12,324 WARN [Listener at localhost/35655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 06:02:12,330 INFO [Listener at localhost/35655] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 06:02:12,414 WARN [Listener at localhost/35655] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/mapreduce.cluster.local.dir/1676527332376/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 06:02:12,414 WARN [Listener at localhost/35655] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/mapreduce.cluster.local.dir/1676527332376/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 06:02:12,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 06:02:12,446 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 06:02:12,446 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 06:02:12,448 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:12,449 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1 2023-02-16 06:02:12,449 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e77fb4f90bc8ded27009d4434be233a columnFamilyName f1 2023-02-16 06:02:12,452 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(539): loaded hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/testWithMapReduce=6e77fb4f90bc8ded27009d4434be233a-d7b02c66467944ebb3addfd7dd223b77 2023-02-16 06:02:12,453 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(310): Store=6e77fb4f90bc8ded27009d4434be233a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:12,453 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:12,453 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2 2023-02-16 06:02:12,454 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e77fb4f90bc8ded27009d4434be233a columnFamilyName f2 2023-02-16 06:02:12,457 DEBUG [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(539): loaded hdfs://localhost:39751/user/jenkins/test-data/f64c9f7f-1394-bca7-ea63-e7188cea5d27/testWithMapReduceSingleRegion/81ab3804-4a56-418f-96fc-6e387f0e8b30/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/testWithMapReduce=6e77fb4f90bc8ded27009d4434be233a-e1b479a83e3b4733b7d890039a28f9b9 2023-02-16 06:02:12,457 INFO [StoreOpener-6e77fb4f90bc8ded27009d4434be233a-1] regionserver.HStore(310): Store=6e77fb4f90bc8ded27009d4434be233a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 06:02:12,457 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 06:02:12,457 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6e77fb4f90bc8ded27009d4434be233a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67179074, jitterRate=0.001046210527420044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 06:02:12,457 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:12,616 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 06:02:12,664 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6e77fb4f90bc8ded27009d4434be233a, disabling compactions & flushes 2023-02-16 06:02:12,664 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:12,664 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:12,664 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. after waiting 0 ms 2023-02-16 06:02:12,664 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:12,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:12,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:13,449 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-16 06:02:13,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-16 06:02:13,452 INFO [Listener at localhost/35655] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 06:02:13,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 06:02:13,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:13,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527333455"}]},"ts":"1676527333455"} 2023-02-16 06:02:13,456 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 06:02:13,457 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 06:02:13,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, UNASSIGN}] 2023-02-16 06:02:13,458 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, UNASSIGN 2023-02-16 06:02:13,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6e77fb4f90bc8ded27009d4434be233a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:13,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676527333459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676527333459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676527333459"}]},"ts":"1676527333459"} 2023-02-16 06:02:13,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 6e77fb4f90bc8ded27009d4434be233a, server=jenkins-hbase4.apache.org,45201,1676527328760}] 2023-02-16 06:02:13,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:13,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:13,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6e77fb4f90bc8ded27009d4434be233a, disabling compactions & flushes 2023-02-16 06:02:13,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:13,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:13,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. after waiting 0 ms 2023-02-16 06:02:13,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:13,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 06:02:13,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a. 2023-02-16 06:02:13,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6e77fb4f90bc8ded27009d4434be233a: 2023-02-16 06:02:13,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:13,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6e77fb4f90bc8ded27009d4434be233a, regionState=CLOSED 2023-02-16 06:02:13,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676527333619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676527333619"}]},"ts":"1676527333619"} 2023-02-16 06:02:13,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 06:02:13,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 6e77fb4f90bc8ded27009d4434be233a, server=jenkins-hbase4.apache.org,45201,1676527328760 in 160 msec 2023-02-16 06:02:13,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 06:02:13,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6e77fb4f90bc8ded27009d4434be233a, UNASSIGN in 163 msec 2023-02-16 06:02:13,623 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676527333623"}]},"ts":"1676527333623"} 2023-02-16 06:02:13,623 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 06:02:13,625 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 06:02:13,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 173 msec 2023-02-16 06:02:13,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 06:02:13,757 INFO [Listener at localhost/35655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-16 06:02:13,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 06:02:13,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,760 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,761 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:02:13,763 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:13,765 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1, FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2, FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/recovered.edits] 2023-02-16 06:02:13,768 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/672bcb4d1e3c4b9ab608a3ec41c407eb to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/archive/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/672bcb4d1e3c4b9ab608a3ec41c407eb 2023-02-16 06:02:13,769 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/d7b02c66467944ebb3addfd7dd223b77 to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/archive/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f1/d7b02c66467944ebb3addfd7dd223b77 2023-02-16 06:02:13,771 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/bce82a9ddd57429da9e7b4179a3a015f to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/archive/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/bce82a9ddd57429da9e7b4179a3a015f 2023-02-16 06:02:13,772 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/e1b479a83e3b4733b7d890039a28f9b9 to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/archive/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/f2/e1b479a83e3b4733b7d890039a28f9b9 2023-02-16 06:02:13,774 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/recovered.edits/12.seqid to hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/archive/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a/recovered.edits/12.seqid 2023-02-16 06:02:13,775 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/.tmp/data/default/testWithMapReduce/6e77fb4f90bc8ded27009d4434be233a 2023-02-16 06:02:13,775 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 06:02:13,776 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,778 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-16 06:02:13,779 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 06:02:13,780 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,780 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 06:02:13,780 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676527333780"}]},"ts":"9223372036854775807"} 2023-02-16 06:02:13,782 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 06:02:13,782 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e77fb4f90bc8ded27009d4434be233a, NAME => 'testWithMapReduce,,1676527329810.6e77fb4f90bc8ded27009d4434be233a.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 06:02:13,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 06:02:13,782 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676527333782"}]},"ts":"9223372036854775807"} 2023-02-16 06:02:13,786 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 06:02:13,788 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 06:02:13,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 30 msec 2023-02-16 06:02:13,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36191] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 06:02:13,863 INFO [Listener at localhost/35655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-16 06:02:13,863 INFO [Listener at localhost/35655] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 06:02:13,863 INFO [Listener at localhost/35655] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 06:02:13,863 DEBUG [Listener at localhost/35655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49ba3d8c to 127.0.0.1:64011 2023-02-16 06:02:13,863 DEBUG [Listener at localhost/35655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:13,863 DEBUG [Listener at localhost/35655] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 06:02:13,863 DEBUG [Listener at localhost/35655] util.JVMClusterUtil(257): Found active master hash=673605372, stopped=false 2023-02-16 06:02:13,863 INFO [Listener at localhost/35655] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:13,865 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:13,865 INFO [Listener at localhost/35655] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 06:02:13,865 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:13,865 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 06:02:13,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:13,867 DEBUG [Listener at localhost/35655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x579f76bb to 127.0.0.1:64011 2023-02-16 06:02:13,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:13,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 06:02:13,867 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:13,867 DEBUG [Listener at localhost/35655] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:13,868 INFO [Listener at localhost/35655] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45201,1676527328760' ***** 2023-02-16 06:02:13,868 INFO [Listener at localhost/35655] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:02:13,868 INFO [Listener at localhost/35655] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38583,1676527328782' ***** 2023-02-16 06:02:13,868 INFO [Listener at localhost/35655] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 06:02:13,868 INFO [RS:0;jenkins-hbase4:45201] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:02:13,868 INFO [RS:1;jenkins-hbase4:38583] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 06:02:13,868 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:02:13,868 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 06:02:13,868 INFO [RS:1;jenkins-hbase4:38583] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:02:13,868 INFO [RS:0;jenkins-hbase4:45201] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 06:02:13,870 INFO [RS:0;jenkins-hbase4:45201] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:02:13,870 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(3304): Received CLOSE for dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:13,870 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:13,870 DEBUG [RS:0;jenkins-hbase4:45201] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x768aadfd to 127.0.0.1:64011 2023-02-16 06:02:13,870 DEBUG [RS:0;jenkins-hbase4:45201] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:13,870 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 06:02:13,870 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1479): Online Regions={dfae29d564ae75cfd2e3bde69c562995=hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995.} 2023-02-16 06:02:13,870 DEBUG [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1505): Waiting on dfae29d564ae75cfd2e3bde69c562995 2023-02-16 06:02:13,869 INFO [RS:1;jenkins-hbase4:38583] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 06:02:13,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dfae29d564ae75cfd2e3bde69c562995, disabling compactions & flushes 2023-02-16 06:02:13,870 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:13,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:13,871 DEBUG [RS:1;jenkins-hbase4:38583] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64fcc6fb to 127.0.0.1:64011 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. after waiting 0 ms 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:13,871 DEBUG [RS:1;jenkins-hbase4:38583] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:13,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing dfae29d564ae75cfd2e3bde69c562995 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 06:02:13,871 INFO [RS:1;jenkins-hbase4:38583] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:02:13,871 INFO [RS:1;jenkins-hbase4:38583] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:02:13,871 INFO [RS:1;jenkins-hbase4:38583] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:02:13,871 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 06:02:13,871 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 06:02:13,871 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 06:02:13,871 DEBUG [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 06:02:13,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 06:02:13,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 06:02:13,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-16 06:02:13,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/.tmp/info/a7155deaa1944345adf4fd02585ea800 2023-02-16 06:02:13,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/.tmp/info/c14121fa8e69480cb63c88542d8bd790 2023-02-16 06:02:13,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7155deaa1944345adf4fd02585ea800 2023-02-16 06:02:13,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/.tmp/info/c14121fa8e69480cb63c88542d8bd790 as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/info/c14121fa8e69480cb63c88542d8bd790 2023-02-16 06:02:13,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/info/c14121fa8e69480cb63c88542d8bd790, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 06:02:13,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for dfae29d564ae75cfd2e3bde69c562995 in 18ms, sequenceid=6, compaction requested=false 2023-02-16 06:02:13,894 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/.tmp/rep_barrier/6c4aad1d6bb64b4b953fe128077dfed9 2023-02-16 06:02:13,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/namespace/dfae29d564ae75cfd2e3bde69c562995/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 06:02:13,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:13,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dfae29d564ae75cfd2e3bde69c562995: 2023-02-16 06:02:13,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676527329326.dfae29d564ae75cfd2e3bde69c562995. 2023-02-16 06:02:13,900 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c4aad1d6bb64b4b953fe128077dfed9 2023-02-16 06:02:13,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/.tmp/table/c447ad07dc184a0b86c78201f08bb706 2023-02-16 06:02:13,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c447ad07dc184a0b86c78201f08bb706 2023-02-16 06:02:13,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/.tmp/info/a7155deaa1944345adf4fd02585ea800 as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/info/a7155deaa1944345adf4fd02585ea800 2023-02-16 06:02:13,916 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:13,917 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:13,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7155deaa1944345adf4fd02585ea800 2023-02-16 06:02:13,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/info/a7155deaa1944345adf4fd02585ea800, entries=12, sequenceid=21, filesize=6.2 K 2023-02-16 06:02:13,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/.tmp/rep_barrier/6c4aad1d6bb64b4b953fe128077dfed9 as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/rep_barrier/6c4aad1d6bb64b4b953fe128077dfed9 2023-02-16 06:02:13,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c4aad1d6bb64b4b953fe128077dfed9 2023-02-16 06:02:13,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/rep_barrier/6c4aad1d6bb64b4b953fe128077dfed9, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 06:02:13,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/.tmp/table/c447ad07dc184a0b86c78201f08bb706 as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/table/c447ad07dc184a0b86c78201f08bb706 2023-02-16 06:02:13,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c447ad07dc184a0b86c78201f08bb706 2023-02-16 06:02:13,931 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/table/c447ad07dc184a0b86c78201f08bb706, entries=4, sequenceid=21, filesize=5.0 K 2023-02-16 06:02:13,931 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false 2023-02-16 06:02:13,937 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 06:02:13,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 06:02:13,939 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:13,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 06:02:13,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 06:02:14,070 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45201,1676527328760; all regions closed. 2023-02-16 06:02:14,071 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38583,1676527328782; all regions closed. 2023-02-16 06:02:14,073 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,45201,1676527328760/jenkins-hbase4.apache.org%2C45201%2C1676527328760.1676527329681 not finished, retry = 0 2023-02-16 06:02:14,075 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/WALs/jenkins-hbase4.apache.org,38583,1676527328782/jenkins-hbase4.apache.org%2C38583%2C1676527328782.meta.1676527329272.meta not finished, retry = 0 2023-02-16 06:02:14,106 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 06:02:14,106 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 06:02:14,107 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-16 06:02:14,107 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-16 06:02:14,175 DEBUG [RS:0;jenkins-hbase4:45201] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/oldWALs 2023-02-16 06:02:14,176 INFO [RS:0;jenkins-hbase4:45201] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45201%2C1676527328760:(num 1676527329681) 2023-02-16 06:02:14,176 DEBUG [RS:0;jenkins-hbase4:45201] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:14,176 INFO [RS:0;jenkins-hbase4:45201] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:14,176 INFO [RS:0;jenkins-hbase4:45201] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 06:02:14,176 INFO [RS:0;jenkins-hbase4:45201] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 06:02:14,176 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:14,176 INFO [RS:0;jenkins-hbase4:45201] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 06:02:14,176 INFO [RS:0;jenkins-hbase4:45201] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 06:02:14,177 INFO [RS:0;jenkins-hbase4:45201] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45201 2023-02-16 06:02:14,178 DEBUG [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/oldWALs 2023-02-16 06:02:14,178 INFO [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38583%2C1676527328782.meta:.meta(num 1676527329272) 2023-02-16 06:02:14,179 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:14,179 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45201,1676527328760 2023-02-16 06:02:14,179 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:14,179 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:14,179 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ddcacde rejected from java.util.concurrent.ThreadPoolExecutor@29e32dbd[Shutting down, pool size = 1, active threads = 0, queued tasks = 1, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,179 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:14,180 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45201,1676527328760] 2023-02-16 06:02:14,180 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45201,1676527328760; numProcessing=1 2023-02-16 06:02:14,182 DEBUG [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/oldWALs 2023-02-16 06:02:14,182 INFO [RS:1;jenkins-hbase4:38583] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38583%2C1676527328782:(num 1676527330135) 2023-02-16 06:02:14,182 DEBUG [RS:1;jenkins-hbase4:38583] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:14,182 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45201,1676527328760 already deleted, retry=false 2023-02-16 06:02:14,182 INFO [RS:1;jenkins-hbase4:38583] regionserver.LeaseManager(133): Closed leases 2023-02-16 06:02:14,182 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45201,1676527328760 expired; onlineServers=1 2023-02-16 06:02:14,182 INFO [RS:1;jenkins-hbase4:38583] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 06:02:14,182 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:14,185 INFO [RS:1;jenkins-hbase4:38583] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38583 2023-02-16 06:02:14,186 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38583,1676527328782 2023-02-16 06:02:14,186 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 06:02:14,186 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e6bb2e5 rejected from java.util.concurrent.ThreadPoolExecutor@6a543bf0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,187 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38583,1676527328782] 2023-02-16 06:02:14,187 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38583,1676527328782; numProcessing=2 2023-02-16 06:02:14,188 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38583,1676527328782 already deleted, retry=false 2023-02-16 06:02:14,188 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38583,1676527328782 expired; onlineServers=0 2023-02-16 06:02:14,188 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36191,1676527328710' ***** 2023-02-16 06:02:14,188 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 06:02:14,189 DEBUG [M:0;jenkins-hbase4:36191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c19f720, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 06:02:14,189 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36191,1676527328710 2023-02-16 06:02:14,189 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36191,1676527328710; all regions closed. 2023-02-16 06:02:14,189 DEBUG [M:0;jenkins-hbase4:36191] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 06:02:14,189 DEBUG [M:0;jenkins-hbase4:36191] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 06:02:14,189 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 06:02:14,189 DEBUG [M:0;jenkins-hbase4:36191] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 06:02:14,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527328910] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676527328910,5,FailOnTimeoutGroup] 2023-02-16 06:02:14,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527328910] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676527328910,5,FailOnTimeoutGroup] 2023-02-16 06:02:14,190 INFO [M:0;jenkins-hbase4:36191] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 06:02:14,191 INFO [M:0;jenkins-hbase4:36191] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 06:02:14,191 INFO [M:0;jenkins-hbase4:36191] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 06:02:14,191 DEBUG [M:0;jenkins-hbase4:36191] master.HMaster(1512): Stopping service threads 2023-02-16 06:02:14,191 INFO [M:0;jenkins-hbase4:36191] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 06:02:14,192 ERROR [M:0;jenkins-hbase4:36191] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 06:02:14,192 INFO [M:0;jenkins-hbase4:36191] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 06:02:14,192 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 06:02:14,194 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 06:02:14,194 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 06:02:14,194 DEBUG [M:0;jenkins-hbase4:36191] zookeeper.ZKUtil(398): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 06:02:14,194 WARN [M:0;jenkins-hbase4:36191] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 06:02:14,194 INFO [M:0;jenkins-hbase4:36191] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 06:02:14,195 INFO [M:0;jenkins-hbase4:36191] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 06:02:14,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 06:02:14,195 DEBUG [M:0;jenkins-hbase4:36191] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 06:02:14,195 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:14,195 DEBUG [M:0;jenkins-hbase4:36191] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:14,195 DEBUG [M:0;jenkins-hbase4:36191] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 06:02:14,195 DEBUG [M:0;jenkins-hbase4:36191] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:14,195 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.66 KB 2023-02-16 06:02:14,202 INFO [M:0;jenkins-hbase4:36191] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/016153a529b2466e8944c1ce5d52d7ca 2023-02-16 06:02:14,206 DEBUG [M:0;jenkins-hbase4:36191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/016153a529b2466e8944c1ce5d52d7ca as hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/016153a529b2466e8944c1ce5d52d7ca 2023-02-16 06:02:14,209 INFO [M:0;jenkins-hbase4:36191] regionserver.HStore(1080): Added hdfs://localhost:39751/user/jenkins/test-data/d5b13f56-2260-29d9-2e1c-ca1820e4b46b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/016153a529b2466e8944c1ce5d52d7ca, entries=17, sequenceid=132, filesize=8.6 K 2023-02-16 06:02:14,210 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/55998, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-16 06:02:14,210 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 06:02:14,210 DEBUG [M:0;jenkins-hbase4:36191] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 06:02:14,212 INFO [M:0;jenkins-hbase4:36191] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 06:02:14,212 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 06:02:14,212 INFO [M:0;jenkins-hbase4:36191] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36191 2023-02-16 06:02:14,213 DEBUG [M:0;jenkins-hbase4:36191] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36191,1676527328710 already deleted, retry=false 2023-02-16 06:02:14,281 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:14,281 INFO [RS:0;jenkins-hbase4:45201] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45201,1676527328760; zookeeper connection closed. 2023-02-16 06:02:14,281 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@15b5a89a rejected from java.util.concurrent.ThreadPoolExecutor@29e32dbd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,281 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:45201-0x1005bb8c7780001, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:14,281 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d791c6e rejected from java.util.concurrent.ThreadPoolExecutor@29e32dbd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,281 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7fa70df7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7fa70df7 2023-02-16 06:02:14,381 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:14,381 INFO [M:0;jenkins-hbase4:36191] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36191,1676527328710; zookeeper connection closed. 2023-02-16 06:02:14,381 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@318b5a09 rejected from java.util.concurrent.ThreadPoolExecutor@35b4c8e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,382 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): master:36191-0x1005bb8c7780000, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:14,382 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2abc3d97 rejected from java.util.concurrent.ThreadPoolExecutor@35b4c8e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,481 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:14,482 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2dfcc5e4 rejected from java.util.concurrent.ThreadPoolExecutor@6a543bf0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,482 DEBUG [Listener at localhost/35655-EventThread] zookeeper.ZKWatcher(600): regionserver:38583-0x1005bb8c7780002, quorum=127.0.0.1:64011, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 06:02:14,482 ERROR [Listener at localhost/35655-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@557395a9 rejected from java.util.concurrent.ThreadPoolExecutor@6a543bf0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 06:02:14,481 INFO [RS:1;jenkins-hbase4:38583] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38583,1676527328782; zookeeper connection closed. 2023-02-16 06:02:14,482 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b4e7e96] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b4e7e96 2023-02-16 06:02:14,482 INFO [Listener at localhost/35655] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 06:02:14,483 WARN [Listener at localhost/35655] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:02:14,487 INFO [Listener at localhost/35655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:14,588 WARN [BP-332056237-172.31.14.131-1676527328132 heartbeating to localhost/127.0.0.1:39751] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:02:14,588 WARN [BP-332056237-172.31.14.131-1676527328132 heartbeating to localhost/127.0.0.1:39751] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-332056237-172.31.14.131-1676527328132 (Datanode Uuid 4e47c406-4bfb-4418-bbc0-68514d968de2) service to localhost/127.0.0.1:39751 2023-02-16 06:02:14,589 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/dfs/data/data3/current/BP-332056237-172.31.14.131-1676527328132] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:14,589 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/dfs/data/data4/current/BP-332056237-172.31.14.131-1676527328132] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:14,591 WARN [Listener at localhost/35655] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 06:02:14,593 INFO [Listener at localhost/35655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:14,694 WARN [BP-332056237-172.31.14.131-1676527328132 heartbeating to localhost/127.0.0.1:39751] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 06:02:14,695 WARN [BP-332056237-172.31.14.131-1676527328132 heartbeating to localhost/127.0.0.1:39751] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-332056237-172.31.14.131-1676527328132 (Datanode Uuid d74a1084-e9e8-4ff9-b6ea-fea13d2a873f) service to localhost/127.0.0.1:39751 2023-02-16 06:02:14,695 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/dfs/data/data1/current/BP-332056237-172.31.14.131-1676527328132] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:14,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a80ed8bc-9518-4429-8cde-f11ab1bcacb4/cluster_ab01db19-acd9-9755-83f0-cffeed2a1591/dfs/data/data2/current/BP-332056237-172.31.14.131-1676527328132] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 06:02:14,708 INFO [Listener at localhost/35655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 06:02:14,826 INFO [Listener at localhost/35655] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 06:02:14,852 INFO [Listener at localhost/35655] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 06:02:14,868 INFO [Listener at localhost/35655] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 273) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:39751 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:39751 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35655 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:39751 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:39751 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:39751 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1688088802) connection to localhost/127.0.0.1:39751 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36191,1676527328710)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39751 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 562) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 323) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 168), AvailableMemoryMB=2556 (was 1659) - AvailableMemoryMB LEAK? -